You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/02/08 22:25:19 UTC
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1319
- Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1319/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections
Error Message:
The operations computed by ComputePlanAction should not be nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
at __randomizedtesting.SeedInfo.seed([54490285FF5F102B:6EE7E75CC13BC945]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections(ComputePlanActionTest.java:469)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13203 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] 2> 1390745 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/init-core-data-001
[junit4] 2> 1390746 WARN (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 1390746 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1390747 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1390748 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001
[junit4] 2> 1390748 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1390748 INFO (Thread-4638) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1390748 INFO (Thread-4638) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1390750 ERROR (Thread-4638) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1390848 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43471
[junit4] 2> 1390851 INFO (zkConnectionManagerCallback-4448-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1390854 INFO (jetty-launcher-4445-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1390856 INFO (jetty-launcher-4445-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1390856 INFO (jetty-launcher-4445-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1390856 INFO (jetty-launcher-4445-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1390856 INFO (jetty-launcher-4445-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48faff{/solr,null,AVAILABLE}
[junit4] 2> 1390859 INFO (jetty-launcher-4445-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@672386{HTTP/1.1,[http/1.1]}{127.0.0.1:40147}
[junit4] 2> 1390859 INFO (jetty-launcher-4445-thread-1) [ ] o.e.j.s.Server Started @1391879ms
[junit4] 2> 1390859 INFO (jetty-launcher-4445-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40147}
[junit4] 2> 1390859 ERROR (jetty-launcher-4445-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1390859 INFO (jetty-launcher-4445-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1390859 INFO (jetty-launcher-4445-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1390859 INFO (jetty-launcher-4445-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1390860 INFO (jetty-launcher-4445-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-08T21:45:18.596Z
[junit4] 2> 1390861 INFO (zkConnectionManagerCallback-4450-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1390862 INFO (jetty-launcher-4445-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1390870 INFO (jetty-launcher-4445-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43471/solr
[junit4] 2> 1390871 INFO (zkConnectionManagerCallback-4454-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1390873 INFO (zkConnectionManagerCallback-4456-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1390926 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1390926 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40147_solr
[junit4] 2> 1390927 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer Overseer (id=72115886928691203-127.0.0.1:40147_solr-n_0000000000) starting
[junit4] 2> 1390931 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1390931 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1390931 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40147_solr
[junit4] 2> 1390932 INFO (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1390932 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1390932 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:40147_solr]
[junit4] 2> 1390932 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 1390932 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1390939 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1390939 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1390939 DEBUG (ScheduledTrigger-4937-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1391047 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40147.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1391056 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40147.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1391056 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40147.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1391058 INFO (jetty-launcher-4445-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001/node1/.
[junit4] 2> 1391075 INFO (zkConnectionManagerCallback-4460-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1391078 INFO (zkConnectionManagerCallback-4464-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1391079 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1391080 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43471/solr ready
[junit4] 2> 1391087 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLost
[junit4] 2> 1391088 DEBUG (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1391088 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1391089 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1391090 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1391090 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1391091 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1391105 INFO (qtp13420747-15444) [n:127.0.0.1:40147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1391107 DEBUG (qtp13420747-15407) [n:127.0.0.1:40147_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1391108 INFO (qtp13420747-15407) [n:127.0.0.1:40147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=14
[junit4] 2> 1391108 DEBUG (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 1391108 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 1391108 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1391108 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1391108 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 1391111 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1391111 DEBUG (qtp13420747-15411) [n:127.0.0.1:40147_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1391112 INFO (qtp13420747-15411) [n:127.0.0.1:40147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 1391112 DEBUG (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 1391112 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 1391112 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1391113 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1391113 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 1391113 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1391114 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1391114 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1391114 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1391114 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d86ca2{/solr,null,AVAILABLE}
[junit4] 2> 1391115 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@8ebef5{HTTP/1.1,[http/1.1]}{127.0.0.1:32799}
[junit4] 2> 1391115 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.Server Started @1392135ms
[junit4] 2> 1391115 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=32799}
[junit4] 2> 1391115 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1391115 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1391115 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1391115 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1391115 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-08T21:45:18.852Z
[junit4] 2> 1391116 INFO (zkConnectionManagerCallback-4467-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1391117 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1391124 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43471/solr
[junit4] 2> 1391125 INFO (zkConnectionManagerCallback-4471-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1391127 INFO (zkConnectionManagerCallback-4473-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1391131 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1391131 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:32799_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1391133 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:32799_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32799_solr
[junit4] 2> 1391133 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:32799_solr"} current state version: 0
[junit4] 2> 1391133 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1391133 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:32799_solr
[junit4] 2> 1391133 INFO (zkCallback-4472-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1391134 INFO (zkCallback-4463-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1391134 INFO (zkCallback-4463-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1391270 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:32799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32799.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1391290 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:32799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32799.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1391291 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:32799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32799.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1391292 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:32799_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001/node2/.
[junit4] 2> 1391327 INFO (qtp6436829-15448) [n:127.0.0.1:32799_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1391328 INFO (qtp13420747-15412) [n:127.0.0.1:40147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1391329 DEBUG (qtp13420747-15443) [n:127.0.0.1:40147_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1391329 INFO (qtp13420747-15443) [n:127.0.0.1:40147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 1391330 DEBUG (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 1391330 DEBUG (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:40147_solr, 127.0.0.1:32799_solr]
[junit4] 2> 1391330 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 1391331 INFO (qtp6436829-15454) [n:127.0.0.1:32799_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1391332 DEBUG (ScheduledTrigger-4937-thread-1) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1391333 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1391333 DEBUG (OverseerAutoScalingTriggerThread-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 1391334 INFO (OverseerThreadFactory-4939-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testNodeLost
[junit4] 2> 1391340 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1391341 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1391350 INFO (OverseerThreadFactory-4939-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 889479524 sessionWrapper.createTime 889479516373342, this.sessionWrapper.createTime 889479516373342
[junit4] 2> 1391352 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"testNodeLost",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 1391352 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeLost
[junit4] 2> 1391352 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/testNodeLost/state.json
[junit4] 2> 1391455 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 1391455 INFO (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1391456 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 1391456 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 1391456 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 1391457 INFO (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1391457 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 1391457 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 1391558 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 0
[junit4] 2> 1391659 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1391659 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1391659 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1391659 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"http://127.0.0.1:32799/solr","node_name":"127.0.0.1:32799_solr","state":"down","type":"NRT"}
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "node_name":"127.0.0.1:40147_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "node_name":"127.0.0.1:40147_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeLost_shard1_replica_n1","base_url":"http://127.0.0.1:40147/solr","node_name":"127.0.0.1:40147_solr","state":"down","type":"NRT"}
[junit4] 2> 1391662 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "node_name":"127.0.0.1:40147_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 1391763 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 1
[junit4] 2> 1391763 INFO (zkCallback-4472-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1391763 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1391764 INFO (zkCallback-4455-thread-2-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1391764 INFO (zkCallback-4472-thread-2-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1392333 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1392671 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1392671 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1392679 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n2] Schema name=minimal
[junit4] 2> 1392679 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1392681 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1392681 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1392681 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n1' using configuration from collection testNodeLost, trusted=true
[junit4] 2> 1392681 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n2' using configuration from collection testNodeLost, trusted=true
[junit4] 2> 1392682 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32799.solr.core.testNodeLost.shard1.replica_n2' (registry 'solr.core.testNodeLost.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1392682 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40147.solr.core.testNodeLost.shard1.replica_n1' (registry 'solr.core.testNodeLost.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1392682 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1392682 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1392682 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001/node2/testNodeLost_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001/node2/./testNodeLost_shard1_replica_n2/data/]
[junit4] 2> 1392682 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001/node1/testNodeLost_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001/node1/./testNodeLost_shard1_replica_n1/data/]
[junit4] 2> 1392749 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1392749 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1392750 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1392750 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1392752 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@e89788[testNodeLost_shard1_replica_n2] main]
[junit4] 2> 1392753 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1392753 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1392753 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1392753 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1392754 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1392754 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1392754 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1392754 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591870824635170816
[junit4] 2> 1392756 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@143a661[testNodeLost_shard1_replica_n1] main]
[junit4] 2> 1392757 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1392757 INFO (searcherExecutor-4949-thread-1-processing-n:127.0.0.1:32799_solr x:testNodeLost_shard1_replica_n2 s:shard1 c:testNodeLost r:core_node4) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n2] Registered new searcher Searcher@e89788[testNodeLost_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1392757 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1392758 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1392759 INFO (searcherExecutor-4948-thread-1-processing-n:127.0.0.1:40147_solr x:testNodeLost_shard1_replica_n1 s:shard1 c:testNodeLost r:core_node3) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n1] Registered new searcher Searcher@143a661[testNodeLost_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1392759 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591870824640413696
[junit4] 2> 1392760 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 1392760 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost"} current state version: 0
[junit4] 2> 1392861 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 2
[junit4] 2> 1392862 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1392862 INFO (zkCallback-4472-thread-2-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1392862 INFO (zkCallback-4472-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1392862 INFO (zkCallback-4455-thread-2-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393261 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1393261 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1393261 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:32799/solr/testNodeLost_shard1_replica_n2/
[junit4] 2> 1393262 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n2 url=http://127.0.0.1:32799/solr START replicas=[http://127.0.0.1:40147/solr/testNodeLost_shard1_replica_n1/] nUpdates=100
[junit4] 2> 1393265 INFO (qtp13420747-15445) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.S.Request [testNodeLost_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1393333 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1393562 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n2 url=http://127.0.0.1:32799/solr DONE. We have no versions. sync failed.
[junit4] 2> 1393562 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1393562 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1393562 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1393567 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:32799/solr/testNodeLost_shard1_replica_n2/ shard1
[junit4] 2> 1393567 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 1393668 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 3
[junit4] 2> 1393669 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393669 INFO (zkCallback-4472-thread-2-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393669 INFO (zkCallback-4472-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393669 INFO (zkCallback-4455-thread-2-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393717 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1393719 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1393719 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 1393719 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"http://127.0.0.1:32799/solr","node_name":"127.0.0.1:32799_solr","state":"active","type":"NRT","leader":"true"}
[junit4] 2> 1393719 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "node_name":"127.0.0.1:40147_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 1393744 INFO (qtp6436829-15452) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2085
[junit4] 2> 1393765 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "node_name":"127.0.0.1:40147_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1393765 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "node_name":"127.0.0.1:40147_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 1393766 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeLost_shard1_replica_n1","base_url":"http://127.0.0.1:40147/solr","node_name":"127.0.0.1:40147_solr","state":"active","type":"NRT"}
[junit4] 2> 1393766 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "node_name":"127.0.0.1:40147_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:32799/solr",
[junit4] 2> "node_name":"127.0.0.1:32799_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 1393766 INFO (qtp13420747-15413) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2107
[junit4] 2> 1393770 INFO (qtp6436829-15454) [n:127.0.0.1:32799_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1393866 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 4
[junit4] 2> 1393867 INFO (zkCallback-4455-thread-2-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393867 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393867 INFO (zkCallback-4472-thread-2-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1393867 INFO (zkCallback-4472-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1394334 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1394770 INFO (qtp6436829-15454) [n:127.0.0.1:32799_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3438
[junit4] 2> 1394773 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1394774 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1394774 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1394774 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1394774 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@124077c{/solr,null,AVAILABLE}
[junit4] 2> 1394775 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@f7d977{HTTP/1.1,[http/1.1]}{127.0.0.1:35065}
[junit4] 2> 1394775 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.Server Started @1395796ms
[junit4] 2> 1394775 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35065}
[junit4] 2> 1394775 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1394775 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1394776 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1394776 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1394776 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-08T21:45:22.513Z
[junit4] 2> 1394777 INFO (zkConnectionManagerCallback-4477-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1394778 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1394786 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43471/solr
[junit4] 2> 1394787 INFO (zkConnectionManagerCallback-4481-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1394790 INFO (zkConnectionManagerCallback-4483-thread-1-processing-n:127.0.0.1:35065_solr) [n:127.0.0.1:35065_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1394793 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:35065_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1394794 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:35065_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1394795 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:35065_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35065_solr
[junit4] 2> 1394796 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:35065_solr"} current state version: 0
[junit4] 2> 1394796 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:35065_solr
[junit4] 2> 1394796 INFO (zkCallback-4463-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1394796 INFO (zkCallback-4463-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1394796 INFO (zkCallback-4482-thread-1-processing-n:127.0.0.1:35065_solr) [n:127.0.0.1:35065_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1394796 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1394796 INFO (zkCallback-4472-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1394971 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:35065_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35065.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1394982 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:35065_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35065.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1394982 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:35065_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35065.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@47762
[junit4] 2> 1394983 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [n:127.0.0.1:35065_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001/tempDir-001/node3/.
[junit4] 2> 1395041 INFO (zkConnectionManagerCallback-4487-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1395044 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@8ebef5{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1395044 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=17928080
[junit4] 2> 1395044 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1395044 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a2d9a0: rootName = solr_32799, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@994c6
[junit4] 2> 1395051 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1395051 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1014463: rootName = solr_32799, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1fb4f2a
[junit4] 2> 1395055 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1395055 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@9cd2b: rootName = solr_32799, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1eebfc4
[junit4] 2> 1395056 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:32799_solr
[junit4] 2> 1395057 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1395057 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:32799_solr"} current state version: 0
[junit4] 2> 1395057 INFO (zkCallback-4472-thread-1-processing-n:127.0.0.1:32799_solr) [n:127.0.0.1:32799_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1395057 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:32799_solr
[junit4] 2> 1395057 INFO (zkCallback-4463-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1395057 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.NodeMutator Update replica state for core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"http://127.0.0.1:32799/solr","node_name":"127.0.0.1:32799_solr","state":"active","type":"NRT","leader":"true"} to down
[junit4] 2> 1395057 INFO (zkCallback-4482-thread-1-processing-n:127.0.0.1:35065_solr) [n:127.0.0.1:35065_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1395057 INFO (coreCloseExecutor-4964-thread-1) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@23fa78
[junit4] 2> 1395057 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1395057 INFO (zkCallback-4463-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1395057 INFO (coreCloseExecutor-4964-thread-1) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeLost.shard1.replica_n2, tag=2357880
[junit4] 2> 1395057 INFO (coreCloseExecutor-4964-thread-1) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15773e1: rootName = solr_32799, domain = solr.core.testNodeLost.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testNodeLost.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@19e47a7
[junit4] 2> 1395066 INFO (coreCloseExecutor-4964-thread-1) [n:127.0.0.1:32799_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeLost.shard1.leader, tag=2357880
[junit4] 2> 1395069 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1d86ca2{/solr,null,UNAVAILABLE}
[junit4] 2> 1395070 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1395070 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[54490285FF5F102B]) [ ] o.a.s.c.a.ComputePlanActionTest Stopped_node : 127.0.0.1:32799_solr
[junit4] 2> 1395071 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1395071 INFO (zkConnectionManagerCallback-4489-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1395071 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost"} current state version: 0
[junit4] 2> 1395172 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 5
[junit4] 2> 1395172 INFO (zkCallback-4455-thread-2-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1395172 INFO (zkCallback-4455-thread-3-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1395334 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1395334 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:32799_solr
[junit4] 2> 1395337 INFO (OverseerCollectionConfigSetProcessor-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1396335 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1397335 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1397571 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40147/solr/testNodeLost_shard1_replica_n1/
[junit4] 2> 1397571 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1397571 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:40147/solr/testNodeLost_shard1_replica_n1/ has no replicas
[junit4] 2> 1397574 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40147/solr/testNodeLost_shard1_replica_n1/ shard1
[junit4] 2> 1397574 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "base_url":"http://127.0.0.1:40147/solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 1397574 DEBUG (OverseerStateUpdate-72115886928691203-127.0.0.1:40147_solr-n_0000000000) [n:127.0.0.1:40147_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 6
[junit4] 2> 1397575 INFO (zkCallback-4455-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1397575 INFO (zkCallback-4455-thread-3-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1398336 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1399336 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1400336 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1401337 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1402337 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1402337 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:32799_solr]
[junit4] 2> 1402337 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"328fb049569ffTd9pz0vetnzj44jji5adfzfr13",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":889483508935167,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[889483508935167],
[junit4] 2> "nodeNames":["127.0.0.1:32799_solr"]}}
[junit4] 2> 1402338 DEBUG (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger]
[junit4] 2> 1402339 INFO (ScheduledTrigger-4937-thread-3) [n:127.0.0.1:40147_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 1402339 DEBUG (AutoscalingActionExecutor-4938-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"328fb049569ffTd9pz0vetnzj44jji5adfzfr13",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":889483508935167,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[889483508935167],
[junit4] 2> "_enqueue_time_":889490512934703,
[junit4] 2> "nodeNames":["127.0.0.1:32799_solr"]}}
[junit4] 2> 1402340 DEBUG (AutoscalingActionExecutor-4938-thread-1-processing-n:127.0.0.1:40147_solr) [n:127.0.0.1:40147_solr ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"328fb049569ffTd9pz0vetnzj44jji5adfzfr13",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":889483508935167,
[junit4]
[...truncated too long message...]
on] for collection [testNodeAdded] has occurred - updating... (live nodes size: [0])
[junit4] 2> 1435493 INFO (zkCallback-4565-thread-2-processing-n:127.0.0.1:35603_solr) [n:127.0.0.1:35603_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1435493 INFO (zkCallback-4532-thread-3-processing-n:127.0.0.1:41079_solr) [n:127.0.0.1:41079_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [0])
[junit4] 2> 1435493 INFO (jetty-closer-4446-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7843e9{/solr,null,UNAVAILABLE}
[junit4] 2> 1435494 INFO (jetty-closer-4446-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1435494 DEBUG (OverseerStateUpdate-72115886928691227-127.0.0.1:41079_solr-n_0000000006) [n:127.0.0.1:41079_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:35603_solr"} current state version: 0
[junit4] 2> 1435494 DEBUG (OverseerStateUpdate-72115886928691227-127.0.0.1:41079_solr-n_0000000006) [n:127.0.0.1:41079_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:35603_solr
[junit4] 2> 1435502 INFO (coreCloseExecutor-5133-thread-1) [n:127.0.0.1:41079_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeAdded.shard1.leader, tag=26221606
[junit4] 2> 1435502 INFO (coreCloseExecutor-5133-thread-2) [n:127.0.0.1:41079_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeAdded.shard1.replica_n2, tag=10548742
[junit4] 2> 1435502 INFO (coreCloseExecutor-5133-thread-2) [n:127.0.0.1:41079_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1cf074d: rootName = solr_41079, domain = solr.core.testNodeAdded.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testNodeAdded.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@a31baa
[junit4] 2> 1435513 INFO (coreCloseExecutor-5133-thread-2) [n:127.0.0.1:41079_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeAdded.shard1.leader, tag=10548742
[junit4] 2> 1435514 INFO (jetty-closer-4446-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72115886928691227-127.0.0.1:41079_solr-n_0000000006) closing
[junit4] 2> 1435514 INFO (OverseerStateUpdate-72115886928691227-127.0.0.1:41079_solr-n_0000000006) [n:127.0.0.1:41079_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41079_solr
[junit4] 2> 1435515 WARN (OverseerAutoScalingTriggerThread-72115886928691227-127.0.0.1:41079_solr-n_0000000006) [n:127.0.0.1:41079_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1435516 DEBUG (jetty-closer-4446-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1435516 INFO (jetty-closer-4446-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@57ead2{/solr,null,UNAVAILABLE}
[junit4] 2> 1435516 INFO (jetty-closer-4446-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1435517 ERROR (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1435517 INFO (SUITE-ComputePlanActionTest-seed#[54490285FF5F102B]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43471 43471
[junit4] 2> 1438559 INFO (Thread-4638) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43471 43471
[junit4] 2> 1438560 WARN (Thread-4638) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 15 /solr/aliases.json
[junit4] 2> 15 /solr/clusterprops.json
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 10 /solr/collections/testNodeWithMultipleReplicasLost/terms/shard2
[junit4] 2> 10 /solr/security.json
[junit4] 2> 9 /solr/collections/testNodeWithMultipleReplicasLost/terms/shard1
[junit4] 2> 7 /solr/collections/testSelected3/terms/shard1
[junit4] 2> 6 /solr/collections/testSelected1/terms/shard2
[junit4] 2> 6 /solr/collections/testSelected2/terms/shard1
[junit4] 2> 6 /solr/collections/testSelected1/terms/shard1
[junit4] 2> 6 /solr/collections/testSelected2/terms/shard2
[junit4] 2> 6 /solr/collections/testSelected3/terms/shard2
[junit4] 2> 5 /solr/collections/testNodeLost/terms/shard1
[junit4] 2> 3 /solr/collections/testNodeAdded/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 30 /solr/collections/testSelected1/state.json
[junit4] 2> 30 /solr/collections/testSelected2/state.json
[junit4] 2> 30 /solr/collections/testSelected3/state.json
[junit4] 2> 27 /solr/collections/testNodeWithMultipleReplicasLost/state.json
[junit4] 2> 15 /solr/clusterstate.json
[junit4] 2> 14 /solr/collections/testNodeLost/state.json
[junit4] 2> 9 /solr/collections/testNodeAdded/state.json
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2> 3 /solr/overseer_elect/election/72115886928691203-127.0.0.1:40147_solr-n_0000000000
[junit4] 2> 3 /solr/overseer_elect/election/72115886928691227-127.0.0.1:41079_solr-n_0000000006
[junit4] 2> 2 /solr/overseer_elect/election/72115886928691219-127.0.0.1:44651_solr-n_0000000004
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 53 /solr/live_nodes
[junit4] 2> 48 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_trigger
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_54490285FF5F102B-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=sl-SI, timezone=America/Aruba
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=178946896,total=369201152
[junit4] 2> NOTE: All tests run in this JVM: [StatsComponentTest, ZkCLITest, TestManagedSchema, TestTolerantUpdateProcessorCloud, ZkFailoverTest, AssignBackwardCompatibilityTest, DebugComponentTest, SpatialRPTFieldTypeTest, TestRawResponseWriter, DeleteLastCustomShardedReplicaTest, TestExtendedDismaxParser, RankQueryTest, CoreSorterTest, TestIndexingPerformance, HdfsWriteToMultipleCollectionsTest, LeaderElectionContextKeyTest, TestManagedSynonymGraphFilterFactory, EchoParamsTest, TestDocTermOrds, TestAuthenticationFramework, SolrCloudReportersTest, HdfsBasicDistributedZk2Test, TestStreamBody, CustomHighlightComponentTest, TestNumericTerms64, MoveReplicaTest, DistributedQueryComponentCustomSortTest, UtilsToolTest, OutputWriterTest, TestSolrQueryResponse, SuggesterWFSTTest, HdfsChaosMonkeySafeLeaderTest, TestSortableTextField, TestPointFields, TestSolrCloudWithKerberosAlt, TestLMDirichletSimilarityFactory, OpenCloseCoreStressTest, TestDocumentBuilder, TestHttpShardHandlerFactory, TestSizeLimitedDistributedMap, TestSolrXml, SolrJmxReporterCloudTest, ChangedSchemaMergeTest, TestSSLRandomization, SolrIndexConfigTest, TestCollapseQParserPlugin, OpenExchangeRatesOrgProviderTest, TestNumericRangeQuery32, SubstringBytesRefFilterTest, TestPayloadCheckQParserPlugin, CreateCollectionCleanupTest, FullHLLTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestCSVResponseWriter, TestDistributedSearch, ZkStateReaderTest, TestShardHandlerFactory, JavabinLoaderTest, TestPullReplica, TestCloudNestedDocsSort, TestFastOutputStream, CdcrRequestHandlerTest, TestUniqueKeyFieldResource, TestLuceneIndexBackCompat, CdcrBootstrapTest, CloudExitableDirectoryReaderTest, TestManagedResourceStorage, TestCloudRecovery, TestCollectionAPI, TestCopyFieldCollectionResource, TestStressInPlaceUpdates, HdfsThreadLeakTest, HdfsDirectoryFactoryTest, TestJsonFacets, RuleEngineTest, TemplateUpdateProcessorTest, RemoteQueryErrorTest, TestLocalFSCloudBackupRestore, TestDynamicLoading, SpellCheckCollatorTest, DistribDocExpirationUpdateProcessorTest, TestPKIAuthenticationPlugin, TestRecoveryHdfs, NodeLostTriggerTest, JSONWriterTest, TestMultiWordSynonyms, SimpleFacetsTest, UUIDFieldTest, TestHighlightDedupGrouping, OverseerModifyCollectionTest, TestRemoteStreaming, TestConfigReload, TestRandomFaceting, TestDefaultStatsCache, TestMiniSolrCloudClusterSSL, TestLuceneMatchVersion, DefaultValueUpdateProcessorTest, TestExceedMaxTermLength, NumberUtilsTest, SolrIndexSplitterTest, TestStressLucene, TestSQLHandler, DistributedQueryElevationComponentTest, DocValuesMissingTest, DeleteShardTest, RAMDirectoryFactoryTest, TestOmitPositions, TestConfigSets, LeaderInitiatedRecoveryOnShardRestartTest, AnalysisErrorHandlingTest, ComputePlanActionTest]
[junit4] Completed [342/774 (1!)] on J0 in 47.83s, 4 tests, 1 failure <<< FAILURES!
[...truncated 45481 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_162) - Build # 1334
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1334/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseG1GC
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.analytics.facet.QueryFacetTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.analytics.facet.QueryFacetTest: 1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.analytics.facet.QueryFacetTest:
1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([8CA0E78F588BEFBE]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.analytics.facet.QueryFacetTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([8CA0E78F588BEFBE]:0)
FAILED: org.apache.solr.cloud.AddReplicaTest.test
Error Message:
core_node6:{"core":"addreplicatest_coll_shard1_replica_n5","base_url":"https://127.0.0.1:45215/solr","node_name":"127.0.0.1:45215_solr","state":"active","type":"NRT"}
Stack Trace:
java.lang.AssertionError: core_node6:{"core":"addreplicatest_coll_shard1_replica_n5","base_url":"https://127.0.0.1:45215/solr","node_name":"127.0.0.1:45215_solr","state":"active","type":"NRT"}
at __randomizedtesting.SeedInfo.seed([F32C904E9E886239:7B78AF9430740FC1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.AddReplicaTest.test(AddReplicaTest.java:84)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([F32C904E9E886239:9ED034B324C09D3E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:241)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12704 lines...]
[junit4] Suite: org.apache.solr.cloud.AddReplicaTest
[junit4] 2> 724655 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/init-core-data-001
[junit4] 2> 724655 WARN (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=8 numCloses=8
[junit4] 2> 724655 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 724657 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 724658 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001
[junit4] 2> 724658 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 724658 INFO (Thread-4016) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 724658 INFO (Thread-4016) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 724659 ERROR (Thread-4016) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 724758 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34005
[junit4] 2> 724760 INFO (zkConnectionManagerCallback-1416-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724763 INFO (jetty-launcher-1413-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 724763 INFO (jetty-launcher-1413-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 724764 INFO (jetty-launcher-1413-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 724764 INFO (jetty-launcher-1413-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-4) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 724782 INFO (jetty-launcher-1413-thread-3) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 724785 INFO (jetty-launcher-1413-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 724785 INFO (jetty-launcher-1413-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 724785 INFO (jetty-launcher-1413-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 724789 INFO (jetty-launcher-1413-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@52dd6f0a{/solr,null,AVAILABLE}
[junit4] 2> 724789 INFO (jetty-launcher-1413-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5c35ffb4{/solr,null,AVAILABLE}
[junit4] 2> 724796 INFO (jetty-launcher-1413-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3205515d{/solr,null,AVAILABLE}
[junit4] 2> 724796 INFO (jetty-launcher-1413-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4215c0b5{/solr,null,AVAILABLE}
[junit4] 2> 724798 INFO (jetty-launcher-1413-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@621e390a{SSL,[ssl, http/1.1]}{127.0.0.1:45099}
[junit4] 2> 724798 INFO (jetty-launcher-1413-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@12388988{SSL,[ssl, http/1.1]}{127.0.0.1:36827}
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-2) [ ] o.e.j.s.Server Started @726784ms
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-4) [ ] o.e.j.s.Server Started @726784ms
[junit4] 2> 724798 INFO (jetty-launcher-1413-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@15edcfa4{SSL,[ssl, http/1.1]}{127.0.0.1:46573}
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36827}
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-3) [ ] o.e.j.s.Server Started @726785ms
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46573}
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45099}
[junit4] 2> 724799 ERROR (jetty-launcher-1413-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 724799 ERROR (jetty-launcher-1413-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@706c14a2{SSL,[ssl, http/1.1]}{127.0.0.1:45215}
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-1) [ ] o.e.j.s.Server Started @726785ms
[junit4] 2> 724799 ERROR (jetty-launcher-1413-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45215}
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T06:44:22.960Z
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T06:44:22.960Z
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 724799 ERROR (jetty-launcher-1413-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T06:44:22.960Z
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 724799 INFO (jetty-launcher-1413-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T06:44:22.960Z
[junit4] 2> 724805 INFO (zkConnectionManagerCallback-1420-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724806 INFO (jetty-launcher-1413-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 724809 INFO (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724810 INFO (jetty-launcher-1413-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 724817 INFO (zkConnectionManagerCallback-1418-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724817 INFO (zkConnectionManagerCallback-1422-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724818 INFO (jetty-launcher-1413-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 724818 INFO (jetty-launcher-1413-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 724822 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100413ea0190003, likely client has closed socket
[junit4] 2> 724826 INFO (jetty-launcher-1413-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34005/solr
[junit4] 2> 724827 INFO (jetty-launcher-1413-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34005/solr
[junit4] 2> 724829 INFO (zkConnectionManagerCallback-1429-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724834 INFO (jetty-launcher-1413-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34005/solr
[junit4] 2> 724834 INFO (jetty-launcher-1413-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34005/solr
[junit4] 2> 724838 DEBUG (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$270/572120028@6af4dc3a
[junit4] 2> 724841 INFO (zkConnectionManagerCallback-1437-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724841 INFO (zkConnectionManagerCallback-1434-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724842 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100413ea0190006, likely client has closed socket
[junit4] 2> 724842 INFO (zkConnectionManagerCallback-1440-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724843 DEBUG (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$270/572120028@4bc89c87
[junit4] 2> 724843 DEBUG (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$270/572120028@7ea9f9ff
[junit4] 2> 724845 INFO (zkConnectionManagerCallback-1442-thread-1-processing-n:127.0.0.1:45215_solr) [n:127.0.0.1:45215_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724845 DEBUG (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$270/572120028@18012592
[junit4] 2> 724849 INFO (zkConnectionManagerCallback-1446-thread-1-processing-n:127.0.0.1:45099_solr) [n:127.0.0.1:45099_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724849 INFO (zkConnectionManagerCallback-1444-thread-1-processing-n:127.0.0.1:36827_solr) [n:127.0.0.1:36827_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724861 INFO (zkConnectionManagerCallback-1448-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 724864 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterprops.json
[junit4] 2> 724864 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724864 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterstate.json
[junit4] 2> 724865 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 724865 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/aliases.json
[junit4] 2> 724869 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/security.json
[junit4] 2> 724871 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 724871 DEBUG (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/72129331267698700-127.0.0.1:46573_solr-n_0000000000
[junit4] 2> 724871 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46573_solr
[junit4] 2> 724871 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer Overseer (id=72129331267698700-127.0.0.1:46573_solr-n_0000000000) starting
[junit4] 2> 724886 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 724886 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 724886 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterprops.json
[junit4] 2> 724886 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46573_solr
[junit4] 2> 724886 DEBUG (OverseerAutoScalingTriggerThread-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 724886 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724886 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterprops.json
[junit4] 2> 724886 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterprops.json
[junit4] 2> 724886 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterstate.json
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/live_nodes
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/live_nodes
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/live_nodes
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/autoscaling.json
[junit4] 2> 724887 INFO (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterstate.json
[junit4] 2> 724887 DEBUG (OverseerAutoScalingTriggerThread-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterstate.json
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/aliases.json
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 724887 INFO (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/aliases.json
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/aliases.json
[junit4] 2> 724887 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
[junit4] 2> 724887 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/security.json
[junit4] 2> 724887 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 724887 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/security.json
[junit4] 2> 724887 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
[junit4] 2> 724887 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/security.json
[junit4] 2> 724887 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
[junit4] 2> 724888 INFO (zkCallback-1441-thread-1-processing-n:127.0.0.1:45215_solr) [n:127.0.0.1:45215_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 724888 DEBUG (OverseerAutoScalingTriggerThread-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46573_solr]
[junit4] 2> 724888 DEBUG (OverseerAutoScalingTriggerThread-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 724888 DEBUG (OverseerAutoScalingTriggerThread-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 724888 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/collection-queue-work
[junit4] 2> 724888 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue-work
[junit4] 2> 724888 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 724888 INFO (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 724888 INFO (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 724888 DEBUG (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/72129331267698697-127.0.0.1:45215_solr-n_0000000001
[junit4] 2> 724888 INFO (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 724888 DEBUG (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/72129331267698699-127.0.0.1:45099_solr-n_0000000002
[junit4] 2> 724889 DEBUG (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/72129331267698698-127.0.0.1:36827_solr-n_0000000003
[junit4] 2> 724889 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/overseer_elect/election/72129331267698700-127.0.0.1:46573_solr-n_0000000000
[junit4] 2> 724889 DEBUG (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/72129331267698700-127.0.0.1:46573_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 724889 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/overseer_elect/election/72129331267698697-127.0.0.1:45215_solr-n_0000000001
[junit4] 2> 724889 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/overseer_elect/election/72129331267698699-127.0.0.1:45099_solr-n_0000000002
[junit4] 2> 724889 DEBUG (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/72129331267698697-127.0.0.1:45215_solr-n_0000000001 to know if I could be the leader
[junit4] 2> 724889 DEBUG (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/72129331267698699-127.0.0.1:45099_solr-n_0000000002 to know if I could be the leader
[junit4] 2> 724889 DEBUG (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:45215_solr as DOWN
[junit4] 2> 724889 DEBUG (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:45099_solr as DOWN
[junit4] 2> 724889 DEBUG (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:36827_solr as DOWN
[junit4] 2> 724889 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 724890 INFO (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45099_solr
[junit4] 2> 724890 INFO (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36827_solr
[junit4] 2> 724890 INFO (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45215_solr
[junit4] 2> 724890 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/live_nodes
[junit4] 2> 724890 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/live_nodes
[junit4] 2> 724895 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724895 INFO (zkCallback-1447-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 724897 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724898 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724898 INFO (zkCallback-1441-thread-1-processing-n:127.0.0.1:45215_solr) [n:127.0.0.1:45215_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 724898 INFO (zkCallback-1443-thread-1-processing-n:127.0.0.1:36827_solr) [n:127.0.0.1:36827_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 724905 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 724905 INFO (zkCallback-1445-thread-1-processing-n:127.0.0.1:45099_solr) [n:127.0.0.1:45099_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 724907 DEBUG (OverseerAutoScalingTriggerThread-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 724977 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 724977 DEBUG (OverseerAutoScalingTriggerThread-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 724977 DEBUG (ScheduledTrigger-2719-thread-1) [n:127.0.0.1:46573_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 724997 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 724998 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:45099_solr"} current state version: 0
[junit4] 2> 724998 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:45099_solr
[junit4] 2> 724998 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:36827_solr"} current state version: 0
[junit4] 2> 724998 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:36827_solr
[junit4] 2> 724998 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:45215_solr"} current state version: 0
[junit4] 2> 724998 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:45215_solr
[junit4] 2> 725016 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46573.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725016 INFO (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45215.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725018 INFO (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45099.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725018 INFO (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36827.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46573.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45215.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46573.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45215.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36827.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45099.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36827.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725026 INFO (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45099.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 725027 INFO (jetty-launcher-1413-thread-3) [n:127.0.0.1:46573_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node3/.
[junit4] 2> 725027 INFO (jetty-launcher-1413-thread-1) [n:127.0.0.1:45215_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node1/.
[junit4] 2> 725027 INFO (jetty-launcher-1413-thread-4) [n:127.0.0.1:36827_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node4/.
[junit4] 2> 725027 INFO (jetty-launcher-1413-thread-2) [n:127.0.0.1:45099_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node2/.
[junit4] 2> 725098 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725099 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725157 INFO (zkConnectionManagerCallback-1458-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 725171 INFO (zkConnectionManagerCallback-1462-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 725171 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterprops.json
[junit4] 2> 725171 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/live_nodes
[junit4] 2> 725171 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 725171 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/clusterstate.json
[junit4] 2> 725172 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 725172 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/aliases.json
[junit4] 2> 725172 INFO (SUITE-AddReplicaTest-seed#[F32C904E9E886239]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34005/solr ready
[junit4] 2> 725196 INFO (TEST-AddReplicaTest.test-seed#[F32C904E9E886239]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 725202 INFO (zkConnectionManagerCallback-1464-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 725226 INFO (qtp873343675-9018) [n:127.0.0.1:36827_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&maxShardsPerNode=2&name=addreplicatest_coll&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 725226 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/collection-queue-work
[junit4] 2> 725226 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/collection-queue-work
[junit4] 2> 725226 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/overseer/collection-queue-work/qnr-0000000000
[junit4] 2> 725226 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.ZkDistributedQueue Found child node with improper name: qnr-0000000000
[junit4] 2> 725227 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/collection-queue-work
[junit4] 2> 725227 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/collection-queue-work
[junit4] 2> 725227 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.ZkDistributedQueue Found child node with improper name: qnr-0000000000
[junit4] 2> 725227 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskQueue Returning topN elements: [/overseer/collection-queue-work/qn-0000000000, ]
[junit4] 2> 725227 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ecf]]
[junit4] 2> 725227 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000000] as running
[junit4] 2> 725227 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "name":"addreplicatest_coll",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"}
[junit4] 2> 725230 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
[junit4] 2> 725230 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 725230 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 725230 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 725230 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 725230 DEBUG (OverseerCollectionConfigSetProcessor-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskQueue Peeking for top 99 elements. ExcludeSet: [/overseer/collection-queue-work/qn-0000000000],[]
[junit4] 2> 725230 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000000
[junit4] 2> 725230 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"addreplicatest_coll",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"}
[junit4] 2> 725230 INFO (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection addreplicatest_coll
[junit4] 2> 725231 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.Assign Identify nodes using default
[junit4] 2> 725231 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler creating collections conf node /collections/addreplicatest_coll
[junit4] 2> 725232 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/collections
[junit4] 2> 725232 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/collections
[junit4] 2> 725232 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/collections
[junit4] 2> 725232 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/collections
[junit4] 2> 725232 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/collections
[junit4] 2> 725232 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 725233 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 725233 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.CreateCollectionCmd Check for collection zkNode:addreplicatest_coll
[junit4] 2> 725233 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 725233 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 725233 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/collections
[junit4] 2> 725233 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.CreateCollectionCmd Collection zkNode exists
[junit4] 2> 725234 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725234 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725235 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"addreplicatest_coll",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 725235 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: addreplicatest_coll
[junit4] 2> 725235 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/addreplicatest_coll/state.json
[junit4] 2> 725236 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725236 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725335 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.CreateCollectionCmd Creating SolrCores for new collection addreplicatest_coll, shardNames [shard1, shard2] , message : {
[junit4] 2> "name":"addreplicatest_coll",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"}
[junit4] 2> 725335 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.CreateCollectionCmd Creating core addreplicatest_coll_shard1_replica_n1 as part of shard shard1 of collection addreplicatest_coll on 127.0.0.1:45099_solr
[junit4] 2> 725336 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725336 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725336 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"addreplicatest_coll_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45099/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 725336 INFO (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"addreplicatest_coll_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45099/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 725336 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.CreateCollectionCmd Creating core addreplicatest_coll_shard2_replica_n2 as part of shard shard2 of collection addreplicatest_coll on 127.0.0.1:46573_solr
[junit4] 2> 725337 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 725337 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"addreplicatest_coll_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:45099/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 725337 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725337 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725337 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Expecting [addreplicatest_coll_shard1_replica_n1, addreplicatest_coll_shard2_replica_n2] cores but found {}
[junit4] 2> 725337 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"addreplicatest_coll_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46573/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 725337 INFO (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"addreplicatest_coll_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46573/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 725337 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.SliceMutator Old Slice: shard2:{
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 725337 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.SliceMutator New Slice: shard2:{
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"addreplicatest_coll_shard2_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:46573/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 725437 DEBUG (OverseerThreadFactory-2721-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Expecting [addreplicatest_coll_shard1_replica_n1, addreplicatest_coll_shard2_replica_n2] cores but found {}
[junit4] 2> 725438 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/addreplicatest_coll/state.json version: 0
[junit4] 2> 725438 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725438 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725555 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=addreplicatest_coll_shard2_replica_n2&action=CREATE&numShards=2&collection=addreplicatest_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 725555 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=addreplicatest_coll_shard1_replica_n1&action=CREATE&numShards=2&collection=addreplicatest_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 725556 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 725556 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 725557 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725557 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725557 DEBUG (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.c.ZkController publishing state=down
[junit4] 2> 725557 DEBUG (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 725557 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725557 DEBUG (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.c.ZkController Registering watch for collection addreplicatest_coll
[junit4] 2> 725557 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725558 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725558 DEBUG (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.ZkController Registering watch for collection addreplicatest_coll
[junit4] 2> 725558 DEBUG (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.c.ZkController waiting to find shard id in clusterstate for addreplicatest_coll_shard2_replica_n2
[junit4] 2> 725558 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"addreplicatest_coll_shard2_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:46573/solr",
[junit4] 2> "node_name":"127.0.0.1:46573_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"addreplicatest_coll_shard2_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:46573/solr",
[junit4] 2> "node_name":"127.0.0.1:46573_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 725558 DEBUG (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.ZkController waiting to find shard id in clusterstate for addreplicatest_coll_shard1_replica_n1
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"addreplicatest_coll_shard2_replica_n2","base_url":"https://127.0.0.1:46573/solr","node_name":"127.0.0.1:46573_solr","state":"down","type":"NRT"}
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(addreplicatest_coll//collections/addreplicatest_coll/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{
[junit4] 2> "shard1":{
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"addreplicatest_coll_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:45099/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}},
[junit4] 2> "shard2":{
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"addreplicatest_coll_shard2_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:46573/solr",
[junit4] 2> "node_name":"127.0.0.1:46573_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"addreplicatest_coll_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45099/solr",
[junit4] 2> "node_name":"127.0.0.1:45099_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"addreplicatest_coll_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45099/solr",
[junit4] 2> "node_name":"127.0.0.1:45099_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"addreplicatest_coll",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"addreplicatest_coll_shard1_replica_n1","base_url":"https://127.0.0.1:45099/solr","node_name":"127.0.0.1:45099_solr","state":"down","type":"NRT"}
[junit4] 2> 725558 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(addreplicatest_coll//collections/addreplicatest_coll/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{
[junit4] 2> "shard1":{
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"addreplicatest_coll_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:45099/solr",
[junit4] 2> "node_name":"127.0.0.1:45099_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}},
[junit4] 2> "shard2":{
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"addreplicatest_coll_shard2_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:46573/solr",
[junit4] 2> "node_name":"127.0.0.1:46573_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 725659 DEBUG (OverseerStateUpdate-72129331267698700-127.0.0.1:46573_solr-n_0000000000) [n:127.0.0.1:46573_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/addreplicatest_coll/state.json version: 1
[junit4] 2> 725659 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725659 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725659 INFO (zkCallback-1445-thread-1-processing-n:127.0.0.1:45099_solr) [n:127.0.0.1:45099_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addreplicatest_coll/state.json] for collection [addreplicatest_coll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 725659 INFO (zkCallback-1447-thread-2-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addreplicatest_coll/state.json] for collection [addreplicatest_coll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 725659 INFO (zkCallback-1447-thread-1-processing-n:127.0.0.1:46573_solr) [n:127.0.0.1:46573_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addreplicatest_coll/state.json] for collection [addreplicatest_coll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 725659 INFO (zkCallback-1445-thread-2-processing-n:127.0.0.1:45099_solr) [n:127.0.0.1:45099_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addreplicatest_coll/state.json] for collection [addreplicatest_coll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 725659 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725659 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: children: /solr/overseer/queue
[junit4] 2> 725659 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725659 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725660 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: data: /solr/collections/addreplicatest_coll/state.json
[junit4] 2> 725660 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: children: /solr/overseer/queue
[junit4] 2> 725978 DEBUG (ScheduledTrigger-2719-thread-1) [n:127.0.0.1:46573_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 726566 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 726566 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 726621 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.s.IndexSchema [addreplicatest_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 726621 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.s.IndexSchema [addreplicatest_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 726624 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 726624 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 726624 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'addreplicatest_coll_shard2_replica_n2' using configuration from collection addreplicatest_coll, trusted=true
[junit4] 2> 726624 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'addreplicatest_coll_shard1_replica_n1' using configuration from collection addreplicatest_coll, trusted=true
[junit4] 2> 726624 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45099.solr.core.addreplicatest_coll.shard1.replica_n1' (registry 'solr.core.addreplicatest_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 726624 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46573.solr.core.addreplicatest_coll.shard2.replica_n2' (registry 'solr.core.addreplicatest_coll.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@405cc384
[junit4] 2> 726625 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 726625 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 726625 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.SolrCore [[addreplicatest_coll_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node2/addreplicatest_coll_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node2/./addreplicatest_coll_shard1_replica_n1/data/]
[junit4] 2> 726625 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.c.SolrCore [[addreplicatest_coll_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node3/addreplicatest_coll_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.AddReplicaTest_F32C904E9E886239-001/tempDir-001/node3/./addreplicatest_coll_shard2_replica_n2/data/]
[junit4] 2> 726667 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 726667 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 726669 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 726669 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 726669 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 726669 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 726671 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7b726b88[addreplicatest_coll_shard1_replica_n1] main]
[junit4] 2> 726671 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 726671 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 726672 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 726672 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 726673 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@326a484d[addreplicatest_coll_shard2_replica_n2] main]
[junit4] 2> 726673 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 726674 INFO (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592085934070824960
[junit4] 2> 726675 DEBUG (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 726675 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/configs/conf1
[junit4] 2> 726675 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 726676 INFO (searcherExecutor-2731-thread-1-processing-n:127.0.0.1:45099_solr x:addreplicatest_coll_shard1_replica_n1 s:shard1 c:addreplicatest_coll r:core_node3) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.SolrCore [addreplicatest_coll_shard1_replica_n1] Registered new searcher Searcher@7b726b88[addreplicatest_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 726676 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 726677 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/collections/addreplicatest_coll/terms/shard1
[junit4] 2> 726677 INFO (qtp1986837079-9012) [n:127.0.0.1:46573_solr c:addreplicatest_coll s:shard2 r:core_node4 x:addreplicatest_coll_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 726678 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch fired: data: /solr/collections/addreplicatest_coll/terms/shard1
[junit4] 2> 726678 DEBUG (qtp320603891-9004) [n:127.0.0.1:45099_solr c:addreplicatest_coll s:shard1 r:core_node3 x:addreplicatest_coll_shard1_replica_n1] o.a.s.c.ZkController Register replica - core:addreplicatest_coll_shard1_replica_n1 address:https://127.0.0.1:45099/solr collection:addreplicatest_coll shard:shard1
[junit4] 2> 726678 DEBUG (SyncThread:0) [ ] o.a.s.c.ZkTestServer Watch added: create/delete: /solr/collections/addreplicatest_coll/terms/shard1
[junit4] 2> 726679 INFO (searcherExecutor-2730-thread-1-processing-n:127.0.0.1:46573_solr x:addreplicatest_coll_shard2_replica_n2 s:shard2 c:addreplicatest_coll r:core_node4) [n:127.0.
[...truncated too long message...]
vedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Feb 11, 2018 7:22:58 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] 2> 2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] 2> Feb 11, 2018 7:23:01 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {string_s=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), string_sm=Lucene50(blocksize=128)}, docValues:{int_i=DocValuesFormat(name=Lucene70), double_dm=DocValuesFormat(name=Lucene70), float_fm=DocValuesFormat(name=Lucene70), int_im=DocValuesFormat(name=Memory), date_dt=DocValuesFormat(name=Lucene70), date_dtm=DocValuesFormat(name=Memory), long_lm=DocValuesFormat(name=Memory), double_d=DocValuesFormat(name=Lucene70), float_f=DocValuesFormat(name=Lucene70), long_l=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Lucene70), string_s=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Direct), string_sm=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=712, maxMBSortInHeap=5.188120633580674, sim=RandomSimilarity(queryNorm=false): {}, locale=zh-HK, timezone=BET
[junit4] 2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=3,free=218163752,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [LegacyAbstractAnalyticsFacetTest, CastingFloatValueTest, CastingLongValueStreamTest, LegacyQueryFacetCloudTest, OrFunctionTest, ExistsFunctionTest, SubtractFunctionTest, QueryFacetTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=QueryFacetTest -Dtests.seed=8CA0E78F588BEFBE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh-HK -Dtests.timezone=BET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | QueryFacetTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.analytics.facet.QueryFacetTest:
[junit4] > 1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([8CA0E78F588BEFBE]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=253, name=qtp1726194860-253, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 2) Thread[id=240, name=qtp1726194860-240, state=TIMED_WAITING, group=TGRP-QueryFacetTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([8CA0E78F588BEFBE]:0)
[junit4] Completed [73/78 (1!)] on J1 in 74.81s, 1 test, 2 errors <<< FAILURES!
[...truncated 45182 lines...]
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+42) - Build #
1333 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1333/
Java: 64bit/jdk-10-ea+42 -XX:+UseCompressedOops -XX:+UseG1GC
4 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Could not find collection:collection2
Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
at __randomizedtesting.SeedInfo.seed([10C70EC3CFB92D20:98933119614540D8]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:915)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.ReplaceNodeNoTargetTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([10C70EC3CFB92D20:98933119614540D8]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeAddedTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([10C70EC3CFB92D20:36ADB0FAD4B6824C]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeAddedTrigger(TriggerIntegrationTest.java:456)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost
Error Message:
The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
at __randomizedtesting.SeedInfo.seed([10C70EC3CFB92D20:2007EF4147CBCC7C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost(ComputePlanActionTest.java:291)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12435 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/init-core-data-001
[junit4] 2> 328658 WARN (SUITE-FullSolrCloudDistribCmdsTest-seed#[10C70EC3CFB92D20]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
[junit4] 2> 328658 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[10C70EC3CFB92D20]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 328658 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[10C70EC3CFB92D20]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
[junit4] 2> 328658 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[10C70EC3CFB92D20]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 328658 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[10C70EC3CFB92D20]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /dw_gv/
[junit4] 2> 328659 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 328660 INFO (Thread-533) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 328660 INFO (Thread-533) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 328661 ERROR (Thread-533) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 328760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.ZkTestServer start zk server on port:35933
[junit4] 2> 328762 INFO (zkConnectionManagerCallback-538-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328764 INFO (zkConnectionManagerCallback-540-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328766 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 328767 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 328768 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 328768 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 328769 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 328769 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 328770 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 328770 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 328771 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 328771 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 328772 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 328772 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 328849 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 328850 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 328850 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 328850 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 328850 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@30e7598b{/dw_gv,null,AVAILABLE}
[junit4] 2> 328851 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1bbc3fa8{HTTP/1.1,[http/1.1]}{127.0.0.1:Û³Û¸Û±Û·Ûµ}
[junit4] 2> 328851 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server Started @Û³Û³Û°Û¸Û³Ûµms
[junit4] 2> 328851 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dw_gv, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/tempDir-001/control/data, hostPort=38175, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/control-001/cores, replicaType=NRT}
[junit4] 2> 328852 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 328852 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 328852 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 328852 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 328852 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T02:35:56.580258Z
[junit4] 2> 328853 INFO (zkConnectionManagerCallback-542-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328854 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 328854 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/control-001/solr.xml
[junit4] 2> 328856 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 328856 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 328857 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 328858 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35933/solr
[junit4] 2> 328859 INFO (zkConnectionManagerCallback-546-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328861 INFO (zkConnectionManagerCallback-548-thread-1-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328891 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 328891 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38175_dw_gv
[junit4] 2> 328891 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.Overseer Overseer (id=72128354359836676-127.0.0.1:38175_dw_gv-n_0000000000) starting
[junit4] 2> 328898 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38175_dw_gv
[junit4] 2> 328899 INFO (zkCallback-547-thread-1-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 328929 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 328935 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 328935 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 328936 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/control-001/cores
[junit4] 2> 328946 INFO (zkConnectionManagerCallback-554-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328947 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 328948 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35933/solr ready
[junit4] 2> 328950 INFO (qtp1862759147-2538) [n:127.0.0.1:38175_dw_gv ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:38175_dw_gv&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 328952 INFO (OverseerThreadFactory-961-thread-1-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 329055 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 329055 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 329159 INFO (zkCallback-547-thread-1-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 330069 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 330077 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 330109 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 330116 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 330116 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 330116 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 330116 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 330118 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=48.8427734375, floorSegmentMB=0.4423828125, forceMergeDeletesPctAllowed=17.73050861885778, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8479960116003351
[junit4] 2> 330119 WARN (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 330153 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 330153 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 330154 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 330154 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 330154 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=20.720703125, floorSegmentMB=0.3359375, forceMergeDeletesPctAllowed=7.525454669771783, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 330155 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@19564997[control_collection_shard1_replica_n1] main]
[junit4] 2> 330156 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 330156 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 330156 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 330157 INFO (searcherExecutor-964-thread-1-processing-n:127.0.0.1:38175_dw_gv x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@19564997[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 330157 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592070303000821760
[junit4] 2> 330161 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 330161 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 330161 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38175/dw_gv/control_collection_shard1_replica_n1/
[junit4] 2> 330161 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 330161 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:38175/dw_gv/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 330161 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 330163 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38175/dw_gv/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 330264 INFO (zkCallback-547-thread-2-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 330313 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 330320 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1264
[junit4] 2> 330322 INFO (qtp1862759147-2538) [n:127.0.0.1:38175_dw_gv ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 330416 INFO (zkCallback-547-thread-2-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 330953 INFO (OverseerCollectionConfigSetProcessor-72128354359836676-127.0.0.1:38175_dw_gv-n_0000000000) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 331322 INFO (qtp1862759147-2538) [n:127.0.0.1:38175_dw_gv ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:38175_dw_gv&wt=javabin&version=2} status=0 QTime=2372
[junit4] 2> 331326 INFO (zkConnectionManagerCallback-558-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 331327 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 331328 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35933/solr ready
[junit4] 2> 331328 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 331329 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 331330 INFO (OverseerThreadFactory-961-thread-2-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 331331 WARN (OverseerThreadFactory-961-thread-2-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 331533 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 331533 INFO (qtp1862759147-2544) [n:127.0.0.1:38175_dw_gv ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=204
[junit4] 2> 331618 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-1-001 of type NRT
[junit4] 2> 331619 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 331620 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 331620 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 331620 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 331620 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@203532f6{/dw_gv,null,AVAILABLE}
[junit4] 2> 331620 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@c50678a{HTTP/1.1,[http/1.1]}{127.0.0.1:Û³Û¶Û·Û·Ûµ}
[junit4] 2> 331620 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server Started @Û³Û³Û³Û¶Û°Û´ms
[junit4] 2> 331620 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dw_gv, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/tempDir-001/jetty1, hostPort=36775, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-1-001/cores}
[junit4] 2> 331621 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 331621 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 331621 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 331621 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 331621 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T02:35:59.349328Z
[junit4] 2> 331622 INFO (zkConnectionManagerCallback-560-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 331623 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 331623 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-1-001/solr.xml
[junit4] 2> 331625 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 331625 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 331625 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 331627 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35933/solr
[junit4] 2> 331628 INFO (zkConnectionManagerCallback-564-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 331629 INFO (zkConnectionManagerCallback-566-thread-1-processing-n:127.0.0.1:36775_dw_gv) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 331632 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 331632 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 331633 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36775_dw_gv
[junit4] 2> 331634 INFO (zkCallback-547-thread-1-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 331634 INFO (zkCallback-557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 331634 INFO (zkCallback-565-thread-1-processing-n:127.0.0.1:36775_dw_gv) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 331665 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:36775_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 331672 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:36775_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 331672 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:36775_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 331673 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-1-001/cores
[junit4] 2> 331689 INFO (qtp1863875755-2590) [n:127.0.0.1:36775_dw_gv ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:36775_dw_gv&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 331690 INFO (OverseerCollectionConfigSetProcessor-72128354359836676-127.0.0.1:38175_dw_gv-n_0000000000) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 331690 INFO (OverseerThreadFactory-961-thread-3-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:36775_dw_gv for creating new replica
[junit4] 2> 331692 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 331692 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 332740 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 332746 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema [collection1_shard2_replica_n61] Schema name=test
[junit4] 2> 332777 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 332786 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n61' using configuration from collection collection1, trusted=true
[junit4] 2> 332787 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n61' (registry 'solr.core.collection1.shard2.replica_n61') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 332787 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 332787 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [[collection1_shard2_replica_n61] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-1-001/cores/collection1_shard2_replica_n61], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-1-001/cores/collection1_shard2_replica_n61/data/]
[junit4] 2> 332788 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=48.8427734375, floorSegmentMB=0.4423828125, forceMergeDeletesPctAllowed=17.73050861885778, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8479960116003351
[junit4] 2> 332790 WARN (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 332814 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 332814 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 332815 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 332815 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 332816 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=20.720703125, floorSegmentMB=0.3359375, forceMergeDeletesPctAllowed=7.525454669771783, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 332816 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.SolrIndexSearcher Opening [Searcher@63251628[collection1_shard2_replica_n61] main]
[junit4] 2> 332817 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 332817 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 332818 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 332818 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592070305791082496
[junit4] 2> 332818 INFO (searcherExecutor-975-thread-1-processing-n:127.0.0.1:36775_dw_gv x:collection1_shard2_replica_n61 s:shard2 c:collection1) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [collection1_shard2_replica_n61] Registered new searcher Searcher@63251628[collection1_shard2_replica_n61] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 332822 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 332822 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 332822 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36775/dw_gv/collection1_shard2_replica_n61/
[junit4] 2> 332822 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 332822 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy http://127.0.0.1:36775/dw_gv/collection1_shard2_replica_n61/ has no replicas
[junit4] 2> 332822 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 332844 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36775/dw_gv/collection1_shard2_replica_n61/ shard2
[junit4] 2> 332994 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 333001 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1308
[junit4] 2> 333003 INFO (qtp1863875755-2590) [n:127.0.0.1:36775_dw_gv ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:36775_dw_gv&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1314
[junit4] 2> 333086 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-2-001 of type NRT
[junit4] 2> 333087 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 333087 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 333087 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 333087 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 333088 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@592dddb2{/dw_gv,null,AVAILABLE}
[junit4] 2> 333088 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@53ccd52e{HTTP/1.1,[http/1.1]}{127.0.0.1:Û´ÛµÛ´Û¹Û·}
[junit4] 2> 333088 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server Started @Û³Û³ÛµÛ°Û·Û²ms
[junit4] 2> 333088 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dw_gv, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/tempDir-001/jetty2, hostPort=45497, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-2-001/cores, replicaType=NRT}
[junit4] 2> 333089 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 333089 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 333089 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 333089 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 333089 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T02:36:00.817491Z
[junit4] 2> 333090 INFO (zkConnectionManagerCallback-570-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 333091 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 333091 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-2-001/solr.xml
[junit4] 2> 333093 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 333093 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 333094 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 333095 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35933/solr
[junit4] 2> 333097 INFO (zkConnectionManagerCallback-574-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 333098 INFO (zkConnectionManagerCallback-576-thread-1-processing-n:127.0.0.1:45497_dw_gv) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 333100 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 333101 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 333102 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45497_dw_gv
[junit4] 2> 333102 INFO (zkCallback-557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 333102 INFO (zkCallback-565-thread-1-processing-n:127.0.0.1:36775_dw_gv) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 333103 INFO (zkCallback-547-thread-2-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 333103 INFO (zkCallback-575-thread-1-processing-n:127.0.0.1:45497_dw_gv) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 333134 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:45497_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 333141 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:45497_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 333141 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:45497_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 333142 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-2-001/cores
[junit4] 2> 333167 INFO (qtp1863875755-2594) [n:127.0.0.1:36775_dw_gv ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:45497_dw_gv&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 333169 INFO (OverseerCollectionConfigSetProcessor-72128354359836676-127.0.0.1:38175_dw_gv-n_0000000000) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 333169 INFO (OverseerThreadFactory-961-thread-4-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:45497_dw_gv for creating new replica
[junit4] 2> 333171 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 333171 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 334204 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 334210 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema [collection1_shard3_replica_n63] Schema name=test
[junit4] 2> 334249 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 334257 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n63' using configuration from collection collection1, trusted=true
[junit4] 2> 334257 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard3.replica_n63' (registry 'solr.core.collection1.shard3.replica_n63') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 334257 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 334257 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [[collection1_shard3_replica_n63] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-2-001/cores/collection1_shard3_replica_n63], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-2-001/cores/collection1_shard3_replica_n63/data/]
[junit4] 2> 334259 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=48.8427734375, floorSegmentMB=0.4423828125, forceMergeDeletesPctAllowed=17.73050861885778, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8479960116003351
[junit4] 2> 334263 WARN (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 334341 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 334341 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 334342 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 334342 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 334343 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=20.720703125, floorSegmentMB=0.3359375, forceMergeDeletesPctAllowed=7.525454669771783, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 334343 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.SolrIndexSearcher Opening [Searcher@ce71751[collection1_shard3_replica_n63] main]
[junit4] 2> 334344 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 334345 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 334345 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 334346 INFO (searcherExecutor-986-thread-1-processing-n:127.0.0.1:45497_dw_gv x:collection1_shard3_replica_n63 s:shard3 c:collection1) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [collection1_shard3_replica_n63] Registered new searcher Searcher@ce71751[collection1_shard3_replica_n63] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 334346 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592070307393306624
[junit4] 2> 334350 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 334350 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 334350 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45497/dw_gv/collection1_shard3_replica_n63/
[junit4] 2> 334350 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 334350 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy http://127.0.0.1:45497/dw_gv/collection1_shard3_replica_n63/ has no replicas
[junit4] 2> 334350 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 334351 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45497/dw_gv/collection1_shard3_replica_n63/ shard3
[junit4] 2> 334502 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 334508 INFO (qtp523434969-2623) [n:127.0.0.1:45497_dw_gv c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1337
[junit4] 2> 334510 INFO (qtp1863875755-2594) [n:127.0.0.1:36775_dw_gv ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:45497_dw_gv&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2} status=0 QTime=1343
[junit4] 2> 334581 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-3-001 of type NRT
[junit4] 2> 334582 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 334583 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 334583 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 334583 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 334583 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37be021a{/dw_gv,null,AVAILABLE}
[junit4] 2> 334584 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7157ed3{HTTP/1.1,[http/1.1]}{127.0.0.1:Û³Û¸Û³ÛµÛ³}
[junit4] 2> 334584 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.e.j.s.Server Started @Û³Û³Û¶ÛµÛ¶Û·ms
[junit4] 2> 334584 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dw_gv, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/tempDir-001/jetty3, hostPort=38353, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-3-001/cores, replicaType=NRT}
[junit4] 2> 334584 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 334584 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 334584 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 334584 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 334584 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-11T02:36:02.312773Z
[junit4] 2> 334586 INFO (zkConnectionManagerCallback-580-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 334587 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 334587 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-3-001/solr.xml
[junit4] 2> 334588 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 334589 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 334589 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 334591 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35933/solr
[junit4] 2> 334592 INFO (zkConnectionManagerCallback-584-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 334595 INFO (zkConnectionManagerCallback-586-thread-1-processing-n:127.0.0.1:38353_dw_gv) [n:127.0.0.1:38353_dw_gv ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 334598 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38353_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 334598 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38353_dw_gv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 334599 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38353_dw_gv ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38353_dw_gv
[junit4] 2> 334600 INFO (zkCallback-557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334600 INFO (zkCallback-547-thread-1-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334600 INFO (zkCallback-565-thread-1-processing-n:127.0.0.1:36775_dw_gv) [n:127.0.0.1:36775_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334600 INFO (zkCallback-575-thread-1-processing-n:127.0.0.1:45497_dw_gv) [n:127.0.0.1:45497_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334601 INFO (zkCallback-585-thread-1-processing-n:127.0.0.1:38353_dw_gv) [n:127.0.0.1:38353_dw_gv ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334639 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38353_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 334646 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38353_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 334646 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38353_dw_gv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 334647 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[10C70EC3CFB92D20]) [n:127.0.0.1:38353_dw_gv ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-3-001/cores
[junit4] 2> 334674 INFO (qtp1863875755-2596) [n:127.0.0.1:36775_dw_gv ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38353_dw_gv&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 334676 INFO (OverseerCollectionConfigSetProcessor-72128354359836676-127.0.0.1:38175_dw_gv-n_0000000000) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 334677 INFO (OverseerThreadFactory-961-thread-5-processing-n:127.0.0.1:38175_dw_gv) [n:127.0.0.1:38175_dw_gv ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38353_dw_gv for creating new replica
[junit4] 2> 334679 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 334679 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 335717 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 335726 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema [collection1_shard1_replica_n65] Schema name=test
[junit4] 2> 335776 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 335783 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n65' using configuration from collection collection1, trusted=true
[junit4] 2> 335783 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n65' (registry 'solr.core.collection1.shard1.replica_n65') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbeb9a1
[junit4] 2> 335783 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 335783 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrCore [[collection1_shard1_replica_n65] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-3-001/cores/collection1_shard1_replica_n65], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_10C70EC3CFB92D20-001/shard-3-001/cores/collection1_shard1_replica_n65/data/]
[junit4] 2> 335785 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=48.8427734375, floorSegmentMB=0.4423828125, forceMergeDeletesPctAllowed=17.73050861885778, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8479960116003351
[junit4] 2> 335786 WARN (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 335812 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 335812 INFO (qtp2049251016-2654) [n:127.0.0.1:38353_dw_gv c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaul
[...truncated too long message...]
gerThread has been closed explicitly
[junit4] 2> 2587530 INFO (jetty-closer-4014-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@712dbe41{/solr,null,UNAVAILABLE}
[junit4] 2> 2587530 INFO (jetty-closer-4014-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2589027 INFO (jetty-closer-4014-thread-5) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3376bb56{/solr,null,UNAVAILABLE}
[junit4] 2> 2589027 INFO (jetty-closer-4014-thread-5) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2589028 ERROR (SUITE-TriggerIntegrationTest-seed#[10C70EC3CFB92D20]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2589028 INFO (SUITE-TriggerIntegrationTest-seed#[10C70EC3CFB92D20]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39375 39375
[junit4] 2> 2590359 INFO (Thread-6039) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39375 39375
[junit4] 2> 2590360 WARN (Thread-6039) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 41 /solr/collections/collection1/terms/shard1
[junit4] 2> 23 /solr/aliases.json
[junit4] 2> 22 /solr/security.json
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 10 /solr/collections/testMetricTrigger/terms/shard1
[junit4] 2> 2 /solr/collections/testMetricTrigger/terms/shard2
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 110 /solr/collections/collection1/state.json
[junit4] 2> 35 /solr/collections/testMetricTrigger/state.json
[junit4] 2> 23 /solr/clusterprops.json
[junit4] 2> 23 /solr/clusterstate.json
[junit4] 2> 6 /solr/autoscaling.json
[junit4] 2> 4 /solr/overseer_elect/election/72128488245559335-127.0.0.1:45415_solr-n_0000000011
[junit4] 2> 3 /solr/overseer_elect/election/72128488245559317-127.0.0.1:46485_solr-n_0000000005
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard1/election/72128488245559317-core_node3-n_0000000000
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72128488245559356-core_node6-n_0000000002
[junit4] 2> 2 /solr/overseer_elect/election/72128488245559350-127.0.0.1:37557_solr-n_0000000016
[junit4] 2> 2 /solr/overseer_elect/election/72128488245559344-127.0.0.1:35405_solr-n_0000000014
[junit4] 2> 2 /solr/overseer_elect/election/72128488245559320-127.0.0.1:43361_solr-n_0000000006
[junit4] 2> 2 /solr/overseer_elect/election/72128488245559329-127.0.0.1:42223_solr-n_0000000009
[junit4] 2> 2 /solr/overseer_elect/election/72128488245559356-127.0.0.1:46645_solr-n_0000000018
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72128488245559326-core_node8-n_0000000003
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 23 /solr/live_nodes
[junit4] 2> 23 /solr/collections
[junit4] 2> 6 /solr/overseer/queue-work
[junit4] 2> 6 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 6 /solr/overseer/queue
[junit4] 2> 6 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_triggerMR
[junit4] 2> 2 /solr/autoscaling/events/node_added_triggerCTOOR
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_10C70EC3CFB92D20-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval), x_s=FSTOrd50}, docValues:{}, maxPointsInLeafNode=1672, maxMBSortInHeap=5.449875904069868, sim=RandomSimilarity(queryNorm=false): {}, locale=fy, timezone=Europe/Ulyanovsk
[junit4] 2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10-ea (64-bit)/cpus=8,threads=1,free=154603272,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestLegacyField, TestSimDistributedQueue, CollectionsAPIAsyncDistributedZkTest, IndexSchemaRuntimeFieldTest, SearchHandlerTest, TestAtomicUpdateErrorCases, TestPerFieldSimilarityWithDefaultOverride, TestRequestStatusCollectionAPI, TestRandomDVFaceting, TestNodeAddedTrigger, URLClassifyProcessorTest, JvmMetricsTest, PreAnalyzedFieldTest, TestPayloadScoreQParserPlugin, TestConfigSetsAPIZkFailure, TestNamedUpdateProcessors, HttpSolrCallGetCoreTest, DistributedFacetPivotSmallTest, SimpleCollectionCreateDeleteTest, ClusterStateUpdateTest, UninvertDocValuesMergePolicyTest, TestLMJelinekMercerSimilarityFactory, DirectSolrSpellCheckerTest, TestFieldCache, TestSolrCloudWithDelegationTokens, LeaderElectionTest, SystemLogListenerTest, TestStressReorder, NoCacheHeaderTest, CacheHeaderTest, HdfsSyncSliceTest, CircularListTest, TestBackupRepositoryFactory, OverseerCollectionConfigSetProcessorTest, TestRequestForwarding, BasicDistributedZk2Test, SharedFSAutoReplicaFailoverTest, AssignTest, CdcrUpdateLogTest, TestCoreContainer, TestJsonRequest, TestSQLHandlerNonCloud, TestLockTree, TestHdfsUpdateLog, MultiTermTest, TestReqParamsAPI, UnloadDistributedZkTest, TestImpersonationWithHadoopAuth, DeleteInactiveReplicaTest, TestFiltering, SolrShardReporterTest, DistributedDebugComponentTest, LukeRequestHandlerTest, TestExportWriter, TestManagedSchemaAPI, UniqFieldsUpdateProcessorFactoryTest, DocExpirationUpdateProcessorFactoryTest, NodeAddedTriggerTest, TestClusterStateMutator, LargeFieldTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, RegexBoostProcessorTest, AutoScalingHandlerTest, TestSolrCLIRunExample, HdfsRecoverLeaseTest, CleanupOldIndexTest, BitVectorTest, CollectionsAPISolrJTest, TestSmileRequest, TestNoOpRegenerator, TestMacroExpander, EnumFieldTest, AnalysisAfterCoreReloadTest, TestUtilizeNode, TestFaceting, TestSchemaManager, StatelessScriptUpdateProcessorFactoryTest, WordBreakSolrSpellCheckerTest, TestCollationFieldDocValues, VMParamsZkACLAndCredentialsProvidersTest, UpdateLogTest, DeleteReplicaTest, ReturnFieldsTest, PropertiesRequestHandlerTest, TestSchemaNameResource, SolrGangliaReporterTest, TestJmxIntegration, DistribCursorPagingTest, TestSolrDeletionPolicy2, SearchHandlerTest, SolrJmxReporterTest, TestJavabinTupleStreamParser, TestMinMaxOnMultiValuedField, TestLegacyTerms, SpellCheckCollatorWithCollapseTest, SchemaApiFailureTest, SpellCheckComponentTest, DistributedFacetPivotLargeTest, TestRestManager, TestSolrCoreSnapshots, SolrXmlInZkTest, TestFileDictionaryLookup, TestTolerantSearch, MetricUtilsTest, TestBadConfig, TestPrepRecovery, DistributedQueueTest, DistributedFacetSimpleRefinementLongTailTest, ClassificationUpdateProcessorIntegrationTest, TestShortCircuitedRequests, TestNumericRangeQuery64, DocValuesMultiTest, BadCopyFieldTest, TestUseDocValuesAsStored, ConfigureRecoveryStrategyTest, TestMaxScoreQueryParser, TestSolrFieldCacheBean, BlobRepositoryCloudTest, DistributedQueryComponentOptimizationTest, TestClassicSimilarityFactory, TestQuerySenderListener, TestTrieFacet, BlockCacheTest, TestClusterProperties, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, RecoveryZkTest, TestReplicationHandler, TestRandomFaceting, ZkSolrClientTest, TestZkChroot, ShardRoutingCustomTest, TestDistributedSearch, TestRecovery, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestReload, DistributedTermsComponentTest, TestRangeQuery, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SimplePostToolTest, TestCoreDiscovery, TestExtendedDismaxParser, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesTest, SuggesterTSTTest, SuggesterTest, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, QueryEqualityTest, DistanceFunctionTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, FastVectorHighlighterTest, TestCollationField, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, PingRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, TestLFUCache, TestMergePolicyConfig, TestDocSet, NumericFieldsTest, MinimalSchemaTest, OutputWriterTest, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCodecSupport, EchoParamsTest, TestPerFieldSimilarity, TimeZoneUtilsTest, ScriptEngineTest, TestFastLRUCache, TestSystemIdResolver, DateFieldTest, ClusterStateTest, TestUtils, FileUtilsTest, DistributedMLTComponentTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, AssignBackwardCompatibilityTest, ChaosMonkeySafeLeaderWithPullReplicasTest, DocValuesNotIndexedTest, ForceLeaderTest, PeerSyncReplicationTest, TestAuthenticationFramework, TestCloudSearcherWarming, TestExclusionRuleCollectionAccess, TestLeaderElectionZkExpiry, TestRandomFlRTGCloud, TestTlogReplica, TestHdfsCloudBackupRestore, ComputePlanActionTest, TestPolicyCloud, TriggerIntegrationTest]
[junit4] Completed [639/775 (4!)] on J2 in 218.73s, 14 tests, 1 failure <<< FAILURES!
[...truncated 41570 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.4) - Build # 1332 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1332/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost
Error Message:
The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
at __randomizedtesting.SeedInfo.seed([8BE14BCB0BFD0FE8:BB21AA49838FEEB4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost(ComputePlanActionTest.java:291)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([8BE14BCB0BFD0FE8:31ED7C445415D9A7]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.junit.Assert.assertNull(Assert.java:562)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12452 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_8BE14BCB0BFD0FE8-001/init-core-data-001
[junit4] 2> 253091 WARN (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 253092 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 253092 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 253092 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 253093 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_8BE14BCB0BFD0FE8-001/tempDir-001
[junit4] 2> 253093 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 253093 INFO (Thread-1736) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 253093 INFO (Thread-1736) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 253097 ERROR (Thread-1736) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 253193 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43179
[junit4] 2> 253195 INFO (zkConnectionManagerCallback-707-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253197 INFO (jetty-launcher-704-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 253197 INFO (jetty-launcher-704-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 253198 INFO (jetty-launcher-704-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 253198 INFO (jetty-launcher-704-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 253198 INFO (jetty-launcher-704-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 253198 INFO (jetty-launcher-704-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 253198 INFO (jetty-launcher-704-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 253198 INFO (jetty-launcher-704-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 253198 INFO (jetty-launcher-704-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36a679f9{/solr,null,AVAILABLE}
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1081b246{HTTP/1.1,[http/1.1]}{127.0.0.1:37123}
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@43f3804a{/solr,null,AVAILABLE}
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-1) [ ] o.e.j.s.Server Started @255043ms
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37123}
[junit4] 2> 253199 ERROR (jetty-launcher-704-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3d9210c7{HTTP/1.1,[http/1.1]}{127.0.0.1:43147}
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.e.j.s.Server Started @255043ms
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43147}
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T22:38:47.685684Z
[junit4] 2> 253199 ERROR (jetty-launcher-704-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 253199 INFO (jetty-launcher-704-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T22:38:47.685955Z
[junit4] 2> 253200 INFO (zkConnectionManagerCallback-709-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253200 INFO (zkConnectionManagerCallback-711-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253200 INFO (jetty-launcher-704-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 253201 INFO (jetty-launcher-704-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 253203 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1003f820e940001, likely client has closed socket
[junit4] 2> 253204 INFO (jetty-launcher-704-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43179/solr
[junit4] 2> 253204 INFO (jetty-launcher-704-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43179/solr
[junit4] 2> 253205 INFO (zkConnectionManagerCallback-717-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253205 INFO (zkConnectionManagerCallback-719-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253206 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1003f820e940004, likely client has closed socket
[junit4] 2> 253206 INFO (zkConnectionManagerCallback-723-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253207 INFO (zkConnectionManagerCallback-721-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253251 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 253251 INFO (jetty-launcher-704-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 253251 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43147_solr
[junit4] 2> 253252 INFO (jetty-launcher-704-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37123_solr
[junit4] 2> 253252 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.c.Overseer Overseer (id=72127421860806662-127.0.0.1:43147_solr-n_0000000000) starting
[junit4] 2> 253252 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 253253 INFO (zkCallback-720-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 253261 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 253261 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43147_solr
[junit4] 2> 253261 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 253261 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:37123_solr]
[junit4] 2> 253262 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 253262 INFO (zkCallback-720-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 253262 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 253262 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 253264 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 253264 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 253264 DEBUG (ScheduledTrigger-1330-thread-1) [n:127.0.0.1:43147_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 253279 INFO (jetty-launcher-704-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37123.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 253285 INFO (jetty-launcher-704-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37123.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 253285 INFO (jetty-launcher-704-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37123.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 253286 INFO (jetty-launcher-704-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_8BE14BCB0BFD0FE8-001/tempDir-001/node1/.
[junit4] 2> 253309 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43147.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 253317 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43147.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 253317 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43147.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 253318 INFO (jetty-launcher-704-thread-2) [n:127.0.0.1:43147_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_8BE14BCB0BFD0FE8-001/tempDir-001/node2/.
[junit4] 2> 253340 INFO (zkConnectionManagerCallback-729-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253342 INFO (zkConnectionManagerCallback-733-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 253343 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 253343 INFO (SUITE-TriggerIntegrationTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43179/solr ready
[junit4] 2> 253350 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testContinueTriggersOnOverseerRestart
[junit4] 2> 253351 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 253351 DEBUG (zkCallback-720-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 253351 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 253352 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 253352 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 253352 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 253355 INFO (qtp235791157-4092) [n:127.0.0.1:43147_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 253370 INFO (qtp235791157-4092) [n:127.0.0.1:43147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=15
[junit4] 2> 253387 INFO (qtp970221406-4105) [n:127.0.0.1:37123_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 253389 INFO (qtp235791157-4104) [n:127.0.0.1:43147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 253390 DEBUG (qtp970221406-4093) [n:127.0.0.1:37123_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 253390 INFO (qtp970221406-4093) [n:127.0.0.1:37123_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=9
[junit4] 2> 253391 DEBUG (zkCallback-720-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 253392 DEBUG (zkCallback-720-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:43147_solr, 127.0.0.1:37123_solr]
[junit4] 2> 253392 DEBUG (zkCallback-720-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerCTOOR instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 253392 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 253393 INFO (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 253394 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3d9210c7{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 253394 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 253395 DEBUG (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 253395 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=959843488
[junit4] 2> 253395 DEBUG (ScheduledTrigger-1330-thread-1) [n:127.0.0.1:43147_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 253396 DEBUG (ScheduledTrigger-1330-thread-1) [n:127.0.0.1:43147_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 253396 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 253396 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d91dba1: rootName = solr_43147, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6d26a540
[junit4] 2> 253401 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 253401 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61c504a0: rootName = solr_43147, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@b1ce80f
[junit4] 2> 253404 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 253404 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ae91e3a: rootName = solr_43147, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2b5edccb
[junit4] 2> 253405 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43147_solr
[junit4] 2> 253405 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 253405 INFO (zkCallback-720-thread-1-processing-n:127.0.0.1:43147_solr) [n:127.0.0.1:43147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 253405 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 253408 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 253408 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.Overseer Overseer (id=72127421860806662-127.0.0.1:43147_solr-n_0000000000) closing
[junit4] 2> 253409 INFO (zkCallback-732-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 253409 INFO (OverseerStateUpdate-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43147_solr
[junit4] 2> 253409 WARN (OverseerAutoScalingTriggerThread-72127421860806662-127.0.0.1:43147_solr-n_0000000000) [n:127.0.0.1:43147_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 253409 DEBUG (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 253410 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@43f3804a{/solr,null,UNAVAILABLE}
[junit4] 2> 253410 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37123_solr
[junit4] 2> 253410 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 253410 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.Overseer Overseer (id=72127421860806661-127.0.0.1:37123_solr-n_0000000001) starting
[junit4] 2> 253417 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 253417 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 253417 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:37123_solr]
[junit4] 2> 253417 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerCTOOR instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 253417 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:37123_solr]
[junit4] 2> 253417 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion -1
[junit4] 2> 253417 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 253418 INFO (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 253418 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 253418 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 253419 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 253419 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 254419 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 254419 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 254419 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 255419 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 255419 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 255420 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 256419 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 256420 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 256420 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 257420 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 257420 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 257420 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 258420 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 258420 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 258420 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 259420 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 259420 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 259420 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 260421 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 260421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 260421 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 261421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 261421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 261421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 262421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 262421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 262421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 263411 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 263421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 263421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 263421 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 263492 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 263492 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 263492 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 263508 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@40b70a94{/solr,null,AVAILABLE}
[junit4] 2> 263509 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6908ff4d{HTTP/1.1,[http/1.1]}{127.0.0.1:35301}
[junit4] 2> 263509 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.Server Started @265353ms
[junit4] 2> 263509 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35301}
[junit4] 2> 263509 ERROR (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 263509 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 263509 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 263509 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 263510 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T22:38:57.995994Z
[junit4] 2> 263536 INFO (zkConnectionManagerCallback-735-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 263537 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 263561 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43179/solr
[junit4] 2> 263596 INFO (zkConnectionManagerCallback-739-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 263628 INFO (zkConnectionManagerCallback-741-thread-1-processing-n:127.0.0.1:35301_solr) [n:127.0.0.1:35301_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 263631 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:35301_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 263632 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:35301_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 263634 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:35301_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35301_solr
[junit4] 2> 263634 INFO (zkCallback-732-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 263635 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 263672 INFO (zkCallback-740-thread-1-processing-n:127.0.0.1:35301_solr) [n:127.0.0.1:35301_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 263712 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:35301_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35301.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 263723 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:35301_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35301.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 263724 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:35301_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35301.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 263725 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:35301_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_8BE14BCB0BFD0FE8-001/tempDir-001/node3/.
[junit4] 2> 264422 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 264422 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 264422 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:35301_solr at time 1065499345621658
[junit4] 2> 264422 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 265422 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 265423 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerCTOOR
[junit4] 2> 265423 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 265423 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerCTOOR firing registered processor for nodes: [127.0.0.1:35301_solr] added at times [1065499345621658], now=1065500346660004
[junit4] 2> 265423 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3c910e601129aTbvln4lw02tfo3hu819ufrkucz",
[junit4] 2> "source":"node_added_triggerCTOOR",
[junit4] 2> "eventTime":1065499345621658,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065499345621658],
[junit4] 2> "nodeNames":["127.0.0.1:35301_solr"]}}
[junit4] 2> 265423 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_triggerCTOOR]
[junit4] 2> 265425 INFO (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 265427 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3c910e601129aTbvln4lw02tfo3hu819ufrkucz",
[junit4] 2> "source":"node_added_triggerCTOOR",
[junit4] 2> "eventTime":1065499345621658,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065499345621658],
[junit4] 2> "_enqueue_time_":1065500347700768,
[junit4] 2> "nodeNames":["127.0.0.1:35301_solr"]}}
[junit4] 2> 265428 INFO (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testContinueTriggersOnOverseerRestart
[junit4] 2> 265440 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSetProperties
[junit4] 2> 265441 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 5
[junit4] 2> 265441 DEBUG (zkCallback-722-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 265441 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 265443 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 265443 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 265443 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 265445 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 18 ms for event id=3c910e601129aTbvln4lw02tfo3hu819ufrkucz
[junit4] 2> 266445 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerScheduleDelaySeconds from: 1 to: 4
[junit4] 2> 274447 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerScheduleDelaySeconds from: 4 to: 1
[junit4] 2> 284453 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerCorePoolSize from: 4 to: 6
[junit4] 2> 294457 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSetProperties
[junit4] 2> 294462 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerThrottling
[junit4] 2> 294462 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 6
[junit4] 2> 294463 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 294463 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 294463 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 294463 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 294463 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 294466 INFO (qtp1761557628-4175) [n:127.0.0.1:35301_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 294468 INFO (qtp970221406-4105) [n:127.0.0.1:37123_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 294468 DEBUG (qtp1761557628-4169) [n:127.0.0.1:35301_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 294469 INFO (qtp1761557628-4169) [n:127.0.0.1:35301_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 294469 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 294470 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 294470 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 294470 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 294471 INFO (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 294471 INFO (qtp1761557628-4174) [n:127.0.0.1:35301_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 294471 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 294471 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 294471 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 294471 DEBUG (ScheduledTrigger-1339-thread-3) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 294472 INFO (qtp970221406-4154) [n:127.0.0.1:37123_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 294472 DEBUG (qtp1761557628-4173) [n:127.0.0.1:35301_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 294472 INFO (qtp1761557628-4173) [n:127.0.0.1:35301_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 294472 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 294472 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 294472 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 294473 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 294473 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 294473 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 294473 INFO (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 294474 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 294474 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 294474 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 294474 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 294474 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 294474 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 294474 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 294474 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6b1e2ef7{/solr,null,AVAILABLE}
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3e4c1cc4{HTTP/1.1,[http/1.1]}{127.0.0.1:42527}
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.Server Started @296319ms
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42527}
[junit4] 2> 294475 ERROR (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 294475 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T22:39:28.961715Z
[junit4] 2> 294476 INFO (zkConnectionManagerCallback-745-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 294477 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 294480 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43179/solr
[junit4] 2> 294481 INFO (zkConnectionManagerCallback-749-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 294483 INFO (zkConnectionManagerCallback-751-thread-1-processing-n:127.0.0.1:42527_solr) [n:127.0.0.1:42527_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 294486 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:42527_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 294486 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:42527_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 294487 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:42527_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42527_solr
[junit4] 2> 294488 INFO (zkCallback-740-thread-1-processing-n:127.0.0.1:35301_solr) [n:127.0.0.1:35301_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 294488 INFO (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 294488 INFO (zkCallback-732-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 294488 INFO (zkCallback-750-thread-1-processing-n:127.0.0.1:42527_solr) [n:127.0.0.1:42527_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 294516 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:42527_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42527.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 294522 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:42527_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42527.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 294522 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:42527_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42527.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d7c046
[junit4] 2> 294522 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [n:127.0.0.1:42527_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_8BE14BCB0BFD0FE8-001/tempDir-001/node4/.
[junit4] 2> 295472 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 295472 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 295472 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:42527_solr at time 1065530396214353
[junit4] 2> 295472 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:42527_solr] added at times [1065530396214353], now=1065530396266056
[junit4] 2> 295472 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3c91820c38451Tbvln4lw02tfo3hu819ufrkud1",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1065530396214353,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065530396214353],
[junit4] 2> "nodeNames":["127.0.0.1:42527_solr"]}}
[junit4] 2> 295472 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_trigger2, node_added_trigger1]
[junit4] 2> 295473 INFO (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 295473 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3c91820c38451Tbvln4lw02tfo3hu819ufrkud1",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1065530396214353,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065530396214353],
[junit4] 2> "_enqueue_time_":1065530396429448,
[junit4] 2> "nodeNames":["127.0.0.1:42527_solr"]}}
[junit4] 2> 295474 INFO (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger1
[junit4] 2> 295475 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 295475 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 295475 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event id=3c91820c38451Tbvln4lw02tfo3hu819ufrkud1
[junit4] 2> 300475 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 300475 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 300475 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 300475 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 300475 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:42527_solr at time 1065535399180276
[junit4] 2> 300475 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:42527_solr] added at times [1065535399180276], now=1065535399205362
[junit4] 2> 300475 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3c9194af6b7f4Tbvln4lw02tfo3hu819ufrkud3",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1065535399180276,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065535399180276],
[junit4] 2> "nodeNames":["127.0.0.1:42527_solr"]}}
[junit4] 2> 300476 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_trigger2, node_added_trigger1]
[junit4] 2> 300476 INFO (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 300476 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3c9194af6b7f4Tbvln4lw02tfo3hu819ufrkud3",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1065535399180276,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065535399180276],
[junit4] 2> "_enqueue_time_":1065535399501203,
[junit4] 2> "nodeNames":["127.0.0.1:42527_solr"]}}
[junit4] 2> 300476 INFO (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest last action at 1518302369960000000 current time = 1518302374962000000
[junit4] 2> real diff: 5002000000
[junit4] 2> min diff: 4998000000
[junit4] 2> 300476 INFO (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger2
[junit4] 2> 300477 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 300477 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 300477 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=3c9194af6b7f4Tbvln4lw02tfo3hu819ufrkud3
[junit4] 2> 300479 INFO (qtp1761557628-4173) [n:127.0.0.1:35301_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 300481 INFO (qtp970221406-4154) [n:127.0.0.1:37123_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 300483 INFO (qtp1585072295-4211) [n:127.0.0.1:42527_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 300484 DEBUG (qtp1585072295-4205) [n:127.0.0.1:42527_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 300484 INFO (qtp1585072295-4205) [n:127.0.0.1:42527_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 300485 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 300485 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:42527_solr, 127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 300485 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 300485 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:42527_solr, 127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 300486 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:42527_solr, 127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 300486 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 300486 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
[junit4] 2> 300487 INFO (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 300487 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 300487 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: 3
[junit4] 2> 300488 INFO (qtp1761557628-4175) [n:127.0.0.1:35301_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 300490 INFO (qtp970221406-4105) [n:127.0.0.1:37123_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 300491 INFO (qtp1585072295-4229) [n:127.0.0.1:42527_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 300492 DEBUG (qtp1761557628-4170) [n:127.0.0.1:35301_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 300492 INFO (qtp1761557628-4170) [n:127.0.0.1:35301_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 300492 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 10
[junit4] 2> 300492 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:42527_solr, 127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 300493 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 300493 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:42527_solr, 127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 300493 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:42527_solr, 127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 300493 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 300493 DEBUG (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:42527_solr, 127.0.0.1:35301_solr, 127.0.0.1:37123_solr]
[junit4] 2> 300493 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10
[junit4] 2> 300495 INFO (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 300495 DEBUG (OverseerAutoScalingTriggerThread-72127421860806661-127.0.0.1:37123_solr-n_0000000001) [n:127.0.0.1:37123_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10
[junit4] 2> 300495 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with currently live nodes: 3
[junit4] 2> 300495 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3e4c1cc4{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 300495 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1415130606
[junit4] 2> 300495 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 300495 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@395de5cf: rootName = solr_42527, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@487689ca
[junit4] 2> 300500 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 300500 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@336ad425: rootName = solr_42527, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@b1ce80f
[junit4] 2> 300503 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 300503 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2d907301: rootName = solr_42527, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2b5edccb
[junit4] 2> 300504 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42527_solr
[junit4] 2> 300504 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 300504 INFO (zkCallback-722-thread-2-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 300505 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 300505 INFO (zkCallback-740-thread-1-processing-n:127.0.0.1:35301_solr) [n:127.0.0.1:35301_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 300505 INFO (zkCallback-732-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 300505 INFO (zkCallback-750-thread-1-processing-n:127.0.0.1:42527_solr) [n:127.0.0.1:42527_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 301488 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: 2
[junit4] 2> 301488 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:42527_solr
[junit4] 2> 301488 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:42527_solr]
[junit4] 2> 301488 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3c9198752a50fTbvln4lw02tfo3hu819ufrkud5",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":1065536411837711,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065536411837711],
[junit4] 2> "nodeNames":["127.0.0.1:42527_solr"]}}
[junit4] 2> 301488 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger2, node_added_trigger2, node_lost_trigger1, node_added_trigger1]
[junit4] 2> 301489 INFO (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:37123_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 301489 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3c9198752a50fTbvln4lw02tfo3hu819ufrkud5",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":1065536411837711,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1065536411837711],
[junit4] 2> "_enqueue_time_":1065536412015614,
[junit4] 2> "nodeNames":["127.0.0.1:42527_solr"]}}
[junit4] 2> 301489 INFO (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_lost_trigger1
[junit4] 2> 301490 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger2 after 5000ms
[junit4] 2> 301490 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 301490 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger1 after 5000ms
[junit4] 2> 301490 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 301490 DEBUG (AutoscalingActionExecutor-1340-thread-1-processing-n:127.0.0.1:37123_solr) [n:127.0.0.1:37123_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event id=3c9198752a50fTbvln4lw02tfo3hu819ufrkud5
[junit4] 2> 302005 WARN (zkCallback-750-thread-1-processing-n:127.0.0.1:42527_solr) [n:127.0.0.1:42527_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:42527_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:42527_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:882)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:704)
[junit4] 2> at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4724)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:703)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$900(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1090)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1085)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 302006 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6b1e2ef7{/solr,null,UNAVAILABLE}
[junit4] 2> 302006 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[8BE14BCB0BFD0FE8]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 306490 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 306490 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with currently live nodes: 2
[junit4] 2> 306490 DEBUG (ScheduledTrigger-1339-thread-4) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 306490 DEBUG (ScheduledTrigger-1339-thread-2) [n:127.0.0.1:37123_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:42527_solr
[junit4] 2> 306490 DEBUG (ScheduledTrigger-1339-thread-1) [n:127.0.0.1:371
[...truncated too long message...]
plicasLost.shard1.leader, tag=400621535
[junit4] 2> 2988204 INFO (jetty-closer-5074-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5f62cb28{/solr,null,UNAVAILABLE}
[junit4] 2> 2988204 INFO (jetty-closer-5074-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2988204 ERROR (SUITE-ComputePlanActionTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2988204 INFO (SUITE-ComputePlanActionTest-seed#[8BE14BCB0BFD0FE8]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42775 42775
[junit4] 2> 2998252 INFO (Thread-7586) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42775 42775
[junit4] 2> 2998253 WARN (Thread-7586) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 15 /solr/aliases.json
[junit4] 2> 15 /solr/clusterprops.json
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 10 /solr/security.json
[junit4] 2> 9 /solr/collections/testNodeWithMultipleReplicasLost/terms/shard2
[junit4] 2> 9 /solr/collections/testNodeWithMultipleReplicasLost/terms/shard1
[junit4] 2> 6 /solr/collections/testNodeLost/terms/shard1
[junit4] 2> 5 /solr/collections/testSelected2/terms/shard1
[junit4] 2> 5 /solr/collections/testSelected1/terms/shard2
[junit4] 2> 5 /solr/collections/testSelected1/terms/shard1
[junit4] 2> 5 /solr/collections/testSelected2/terms/shard2
[junit4] 2> 5 /solr/collections/testSelected3/terms/shard2
[junit4] 2> 5 /solr/collections/testSelected3/terms/shard1
[junit4] 2> 3 /solr/collections/testNodeAdded/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 32 /solr/collections/testSelected1/state.json
[junit4] 2> 32 /solr/collections/testSelected3/state.json
[junit4] 2> 31 /solr/collections/testSelected2/state.json
[junit4] 2> 27 /solr/collections/testNodeWithMultipleReplicasLost/state.json
[junit4] 2> 16 /solr/collections/testNodeLost/state.json
[junit4] 2> 15 /solr/clusterstate.json
[junit4] 2> 13 /solr/collections/testNodeAdded/state.json
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2> 3 /solr/overseer_elect/election/72127598486487043-127.0.0.1:37173_solr-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/72127598486487056-127.0.0.1:37893_solr-n_0000000003
[junit4] 2> 2 /solr/collections/testNodeWithMultipleReplicasLost/leader_elect/shard1/election/72127598486487072-core_node5-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/72127598486487062-127.0.0.1:36943_solr-n_0000000005
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 57 /solr/live_nodes
[junit4] 2> 48 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_8BE14BCB0BFD0FE8-001
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=nb-NO, timezone=Europe/Simferopol
[junit4] 2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=263075128,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestSchemaManager, TestSimDistributedQueue, DistanceFunctionTest, UninvertDocValuesMergePolicyTest, TestSolrFieldCacheBean, LargeFieldTest, MultiTermTest, CleanupOldIndexTest, TestSolrCoreProperties, SolrXmlInZkTest, AliasIntegrationTest, CollectionsAPISolrJTest, TestSystemCollAutoCreate, SearchHandlerTest, ConfigureRecoveryStrategyTest, MoreLikeThisHandlerTest, DateMathParserTest, NodeAddedTriggerTest, ClusterStateTest, WordBreakSolrSpellCheckerTest, ClassificationUpdateProcessorIntegrationTest, TestRawTransformer, TestLegacyTerms, AutoscalingHistoryHandlerTest, TestPerFieldSimilarityWithDefaultOverride, TestSolrCLIRunExample, TestAnalyzedSuggestions, TestHashQParserPlugin, DistributedQueryComponentOptimizationTest, TestRandomDVFaceting, ImplicitSnitchTest, TestStressReorder, TestFieldCache, TestReloadDeadlock, StatelessScriptUpdateProcessorFactoryTest, TestFileDictionaryLookup, TestComplexPhraseLeadingWildcard, DeleteReplicaTest, LukeRequestHandlerTest, HdfsDirectoryTest, MigrateRouteKeyTest, SimpleCollectionCreateDeleteTest, TestBadConfig, TestClusterStateProvider, PreAnalyzedUpdateProcessorTest, BasicDistributedZk2Test, RecoveryAfterSoftCommitTest, TestFiltering, TestSQLHandlerNonCloud, RegexBoostProcessorTest, TestChildDocTransformer, OverseerStatusTest, SuggesterTSTTest, TestJavabinTupleStreamParser, TestConfigSetsAPIZkFailure, ClusterStateUpdateTest, TestSolrCoreSnapshots, TestNamedUpdateProcessors, TestLMJelinekMercerSimilarityFactory, TestUseDocValuesAsStored, DistribCursorPagingTest, TestRestManager, AssignTest, TestLegacyField, SolrJmxReporterTest, FileBasedSpellCheckerTest, TestCodecSupport, ConnectionManagerTest, NodeMutatorTest, CollectionsAPIAsyncDistributedZkTest, AtomicUpdateProcessorFactoryTest, PropertiesRequestHandlerTest, TestEmbeddedSolrServerConstructors, DistributedDebugComponentTest, HdfsSyncSliceTest, TestUtilizeNode, BlobRepositoryCloudTest, TestReqParamsAPI, HighlighterMaxOffsetTest, NotRequiredUniqueKeyTest, TestStressCloudBlindAtomicUpdates, TestUninvertingReader, SpatialFilterTest, TestCloudPseudoReturnFields, TestDynamicFieldCollectionResource, UniqFieldsUpdateProcessorFactoryTest, TestLockTree, LeaderElectionTest, TestUpdate, DocValuesTest, TestPayloadScoreQParserPlugin, MoveReplicaHDFSTest, LeaderFailureAfterFreshStartTest, PingRequestHandlerTest, CacheHeaderTest, UpdateLogTest, DocExpirationUpdateProcessorFactoryTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CdcrUpdateLogTest, AnalysisAfterCoreReloadTest, TestConfigSetProperties, TestRequestForwarding, NumericFieldsTest, TestDistribDocBasedVersion, TestAtomicUpdateErrorCases, HdfsAutoAddReplicasIntegrationTest, TestCloudInspectUtil, CustomCollectionTest, HLLSerializationTest, TestDistributedStatsComponentCardinality, SortSpecParsingTest, BJQParserTest, TestSmileRequest, AnalyticsQueryTest, BadCopyFieldTest, BlockCacheTest, DistributedFacetPivotLargeTest, TestLFUCache, UUIDUpdateProcessorFallbackTest, DocValuesMultiTest, DistributedSpellCheckComponentTest, DirectSolrSpellCheckerTest, SolrGangliaReporterTest, CdcrBidirectionalTest, UnloadDistributedZkTest, TestSolrDeletionPolicy2, TestManagedStopFilterFactory, SolrTestCaseJ4Test, ChaosMonkeySafeLeaderTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, RecoveryZkTest, TestReplicationHandler, TestFaceting, TestRecovery, ZkControllerTest, TestReload, TestRangeQuery, ShowFileRequestHandlerTest, SimplePostToolTest, TestCoreDiscovery, TestExtendedDismaxParser, CoreAdminHandlerTest, TestFoldingMultitermQuery, SuggesterTest, TestStressLucene, TestTrie, PolyFieldTest, NoCacheHeaderTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, DirectUpdateHandlerOptimizeTest, TestSolrDeletionPolicy1, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, TestQueryTypes, TestOmitPositions, TermsComponentTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestSolrQueryParser, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, IndexSchemaTest, TestJmxIntegration, ReturnFieldsTest, TestCSVResponseWriter, QueryParsingTest, JsonLoaderTest, TestComponentsName, SOLR749Test, TestQuerySenderListener, CopyFieldTest, ResponseLogComponentTest, SampleTest, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, OutputWriterTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, TestFastOutputStream, URLClassifyProcessorTest, PluginInfoTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, DateFieldTest, RAMDirectoryFactoryTest, TestLRUCache, TestUtils, TestDocumentBuilder, SystemInfoHandlerTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestTolerantSearch, ConnectionReuseTest, AddReplicaTest, AsyncCallRequestStatusResponseTest, CloudExitableDirectoryReaderTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, HttpPartitionTest, LIRRollingUpdatesTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, OverseerTaskQueueTest, RemoteQueryErrorTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, SSLMigrationTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverTest, TestCloudJSONFacetJoinDomain, TestCloudSearcherWarming, TestLeaderElectionZkExpiry, TestLeaderInitiatedRecoveryThread, TestPrepRecovery, TestPullReplicaErrorHandling, TestRebalanceLeaders, TestSolrCloudWithDelegationTokens, TestSolrCloudWithSecureImpersonation, TestTolerantUpdateProcessorCloud, TestTolerantUpdateProcessorRandomCloud, TriLevelCompositeIdRoutingTest, VMParamsZkACLAndCredentialsProvidersTest, ZkShardTermsTest, CollectionsAPIDistributedZkTest, AutoScalingHandlerTest, ComputePlanActionTest]
[junit4] Completed [571/775 (2!)] on J2 in 49.88s, 4 tests, 1 failure <<< FAILURES!
[...truncated 41696 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1331
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1331/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testCooldown
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([BA7A5B25EDBC89F3:8BC436C19316FC01]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testCooldown(TriggerIntegrationTest.java:1177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12407 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001/init-core-data-001
[junit4] 2> 276590 WARN (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 276590 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 276591 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 276591 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 276592 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001/tempDir-001
[junit4] 2> 276592 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 276592 INFO (Thread-465) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 276592 INFO (Thread-465) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 276594 ERROR (Thread-465) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 276692 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41123
[junit4] 2> 276694 INFO (zkConnectionManagerCallback-423-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276696 INFO (jetty-launcher-420-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 276696 INFO (jetty-launcher-420-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 276697 INFO (jetty-launcher-420-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 276697 INFO (jetty-launcher-420-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 276697 INFO (jetty-launcher-420-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 276697 INFO (jetty-launcher-420-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 276697 INFO (jetty-launcher-420-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 276697 INFO (jetty-launcher-420-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 276697 INFO (jetty-launcher-420-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2dee83{/solr,null,AVAILABLE}
[junit4] 2> 276698 INFO (jetty-launcher-420-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5526b1{/solr,null,AVAILABLE}
[junit4] 2> 276698 INFO (jetty-launcher-420-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1f7142f{HTTP/1.1,[http/1.1]}{127.0.0.1:41911}
[junit4] 2> 276698 INFO (jetty-launcher-420-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1b199fc{HTTP/1.1,[http/1.1]}{127.0.0.1:34689}
[junit4] 2> 276698 INFO (jetty-launcher-420-thread-2) [ ] o.e.j.s.Server Started @278725ms
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-1) [ ] o.e.j.s.Server Started @278725ms
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41911}
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34689}
[junit4] 2> 276699 ERROR (jetty-launcher-420-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 276699 ERROR (jetty-launcher-420-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T19:25:05.715Z
[junit4] 2> 276699 INFO (jetty-launcher-420-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T19:25:05.715Z
[junit4] 2> 276700 INFO (zkConnectionManagerCallback-427-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276701 INFO (zkConnectionManagerCallback-426-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276701 INFO (jetty-launcher-420-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 276701 INFO (jetty-launcher-420-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 276715 INFO (jetty-launcher-420-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41123/solr
[junit4] 2> 276716 INFO (jetty-launcher-420-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41123/solr
[junit4] 2> 276723 INFO (zkConnectionManagerCallback-432-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276723 INFO (zkConnectionManagerCallback-435-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276726 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1003ed0b83f0004, likely client has closed socket
[junit4] 2> 276726 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1003ed0b83f0003, likely client has closed socket
[junit4] 2> 276727 INFO (zkConnectionManagerCallback-437-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276760 INFO (zkConnectionManagerCallback-439-thread-1-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276770 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 276770 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34689_solr
[junit4] 2> 276771 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.Overseer Overseer (id=72126660203184134-127.0.0.1:34689_solr-n_0000000000) starting
[junit4] 2> 276795 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34689_solr
[junit4] 2> 276795 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 276801 INFO (zkCallback-438-thread-1-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 276801 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 276802 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:34689_solr]
[junit4] 2> 276802 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 276802 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 276813 INFO (jetty-launcher-420-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 276814 INFO (jetty-launcher-420-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 276817 INFO (jetty-launcher-420-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41911_solr
[junit4] 2> 276822 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 276823 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 276830 DEBUG (ScheduledTrigger-751-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 276843 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 276849 INFO (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 276891 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34689.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 276899 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34689.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 276901 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34689.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 276902 INFO (jetty-launcher-420-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001/tempDir-001/node1/.
[junit4] 2> 276940 INFO (jetty-launcher-420-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41911.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 276948 INFO (jetty-launcher-420-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41911.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 276948 INFO (jetty-launcher-420-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41911.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 276949 INFO (jetty-launcher-420-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001/tempDir-001/node2/.
[junit4] 2> 276973 INFO (zkConnectionManagerCallback-445-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276982 INFO (zkConnectionManagerCallback-449-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276983 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 276983 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41123/solr ready
[junit4] 2> 276993 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
[junit4] 2> 276993 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 276993 DEBUG (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 276993 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 276995 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 276995 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 276995 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 277016 INFO (qtp18883629-1986) [n:127.0.0.1:34689_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=7
[junit4] 2> 277019 INFO (qtp3213306-1926) [n:127.0.0.1:41911_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 277020 DEBUG (qtp18883629-1925) [n:127.0.0.1:34689_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 277020 INFO (qtp18883629-1925) [n:127.0.0.1:34689_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=15
[junit4] 2> 277021 DEBUG (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 277023 DEBUG (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:34689_solr, 127.0.0.1:41911_solr]
[junit4] 2> 277023 DEBUG (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 277024 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 277024 INFO (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 277025 INFO (qtp18883629-1933) [n:127.0.0.1:34689_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 277025 DEBUG (ScheduledTrigger-751-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 277025 DEBUG (ScheduledTrigger-751-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 277026 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 277026 DEBUG (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 277038 INFO (qtp18883629-1933) [n:127.0.0.1:34689_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=12
[junit4] 2> 277039 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 277047 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 277047 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 277047 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 277047 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1bb97fb{/solr,null,AVAILABLE}
[junit4] 2> 277047 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@974778{HTTP/1.1,[http/1.1]}{127.0.0.1:33895}
[junit4] 2> 277047 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.Server Started @279074ms
[junit4] 2> 277047 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33895}
[junit4] 2> 277048 ERROR (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 277048 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 277048 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 277048 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 277048 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T19:25:06.064Z
[junit4] 2> 277050 INFO (zkConnectionManagerCallback-451-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 277050 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 277054 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1003ed0b83f0009, likely client has closed socket
[junit4] 2> 277061 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41123/solr
[junit4] 2> 277064 INFO (zkConnectionManagerCallback-455-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 277071 INFO (zkConnectionManagerCallback-457-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 277075 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 277076 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:33895_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 277077 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:33895_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33895_solr
[junit4] 2> 277077 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 277078 INFO (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 277094 INFO (zkCallback-448-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 277094 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 277152 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:33895_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33895.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 277159 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:33895_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33895.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 277159 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:33895_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33895.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 277160 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:33895_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001/tempDir-001/node3/.
[junit4] 2> 278026 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 278026 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 278027 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:33895_solr at time 1053867480462446
[junit4] 2> 279027 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 279027 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 279035 INFO (OverseerCollectionConfigSetProcessor-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 280028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 280028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 281028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 281028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 282028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 282028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 283028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 283028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 284028 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 284029 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 285029 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 285029 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 286029 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 286029 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 287029 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 287029 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 288030 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 288030 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 288030 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS firing registered processor for nodes: [127.0.0.1:33895_solr] added at times [1053867480462446], now=1053877484203716
[junit4] 2> 288031 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3be7ca4d0346eTqv32djn0k4rzcgbaoiyw91xz",
[junit4] 2> "source":"node_added_triggerEFRS",
[junit4] 2> "eventTime":1053867480462446,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053867480462446],
[junit4] 2> "nodeNames":["127.0.0.1:33895_solr"]}}
[junit4] 2> 288031 DEBUG (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_triggerEFRS]
[junit4] 2> 288032 INFO (ScheduledTrigger-751-thread-3) [n:127.0.0.1:34689_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 288035 DEBUG (AutoscalingActionExecutor-752-thread-1-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3be7ca4d0346eTqv32djn0k4rzcgbaoiyw91xz",
[junit4] 2> "source":"node_added_triggerEFRS",
[junit4] 2> "eventTime":1053867480462446,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053867480462446],
[junit4] 2> "_enqueue_time_":1053877484878555,
[junit4] 2> "nodeNames":["127.0.0.1:33895_solr"]}}
[junit4] 2> 288036 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 288038 DEBUG (AutoscalingActionExecutor-752-thread-1-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerEFRS after 5000ms
[junit4] 2> 288038 DEBUG (AutoscalingActionExecutor-752-thread-1-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 3 ms for event id=3be7ca4d0346eTqv32djn0k4rzcgbaoiyw91xz
[junit4] 2> 288101 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 288101 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 288102 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@87bf94{/solr,null,AVAILABLE}
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@dd094b{HTTP/1.1,[http/1.1]}{127.0.0.1:36637}
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.Server Started @290137ms
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36637}
[junit4] 2> 288111 ERROR (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 288111 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T19:25:17.127Z
[junit4] 2> 288133 INFO (zkConnectionManagerCallback-461-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 288134 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 288163 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41123/solr
[junit4] 2> 288180 INFO (zkConnectionManagerCallback-465-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 288218 INFO (zkConnectionManagerCallback-467-thread-1-processing-n:127.0.0.1:36637_solr) [n:127.0.0.1:36637_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 288222 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36637_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 288225 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36637_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 288229 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36637_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36637_solr
[junit4] 2> 288230 INFO (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 288230 INFO (zkCallback-448-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 288230 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 288230 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 288258 INFO (zkCallback-466-thread-1-processing-n:127.0.0.1:36637_solr) [n:127.0.0.1:36637_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 288367 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36637_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36637.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 288396 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36637_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36637.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 288396 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36637_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36637.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 288398 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36637_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001/tempDir-001/node4/.
[junit4] 2> 293039 DEBUG (ScheduledTrigger-751-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 293039 DEBUG (ScheduledTrigger-751-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 293039 DEBUG (ScheduledTrigger-751-thread-1) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:36637_solr at time 1053882492554905
[junit4] 2> 294039 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 294039 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 295039 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 295039 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 296040 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 296040 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 297040 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 297040 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 298040 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 298040 DEBUG (ScheduledTrigger-751-thread-4) [n:127.0.0.1:34689_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 298464 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1b199fc{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 298464 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=31160662
[junit4] 2> 298464 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 298464 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@546e03: rootName = solr_34689, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@a3347e
[junit4] 2> 298470 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 298470 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2b5521: rootName = solr_34689, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@13137f3
[junit4] 2> 298473 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 298473 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b36992: rootName = solr_34689, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2a79
[junit4] 2> 298475 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34689_solr
[junit4] 2> 298475 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 298475 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 298475 INFO (zkCallback-438-thread-2-processing-n:127.0.0.1:34689_solr) [n:127.0.0.1:34689_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 298475 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 298475 INFO (zkCallback-466-thread-1-processing-n:127.0.0.1:36637_solr) [n:127.0.0.1:36637_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 298475 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 298475 INFO (zkCallback-448-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 298476 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.Overseer Overseer (id=72126660203184134-127.0.0.1:34689_solr-n_0000000000) closing
[junit4] 2> 298476 INFO (OverseerStateUpdate-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34689_solr
[junit4] 2> 298476 WARN (OverseerAutoScalingTriggerThread-72126660203184134-127.0.0.1:34689_solr-n_0000000000) [n:127.0.0.1:34689_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 298476 DEBUG (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 298476 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2dee83{/solr,null,UNAVAILABLE}
[junit4] 2> 298477 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 298477 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41911_solr
[junit4] 2> 298477 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.Overseer Overseer (id=72126660203184133-127.0.0.1:41911_solr-n_0000000001) starting
[junit4] 2> 298479 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 298479 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 298479 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:36637_solr, 127.0.0.1:33895_solr, 127.0.0.1:41911_solr]
[junit4] 2> 298479 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 298480 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36637_solr, 127.0.0.1:33895_solr, 127.0.0.1:41911_solr]
[junit4] 2> 298480 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion -1
[junit4] 2> 298480 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 298480 INFO (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 298480 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Adding node from marker path: 127.0.0.1:36637_solr
[junit4] 2> 298480 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 298481 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 298481 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 298481 DEBUG (ScheduledTrigger-772-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 299481 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 299481 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 299482 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 300481 DEBUG (ScheduledTrigger-772-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 300481 DEBUG (ScheduledTrigger-772-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 300482 DEBUG (ScheduledTrigger-772-thread-4) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 301482 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 301482 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 301482 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 302482 DEBUG (ScheduledTrigger-772-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 302482 DEBUG (ScheduledTrigger-772-thread-2) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 302482 DEBUG (ScheduledTrigger-772-thread-4) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 303482 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
[junit4] 2> 303482 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 303482 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS firing registered processor for nodes: [127.0.0.1:36637_solr] added at times [1053882492554905], now=1053892935985449
[junit4] 2> 303482 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 303482 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3be80239a8e99Tqv32djn0k4rzcgbaoiyw91y1",
[junit4] 2> "source":"node_added_triggerEFRS",
[junit4] 2> "eventTime":1053882492554905,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053882492554905],
[junit4] 2> "nodeNames":["127.0.0.1:36637_solr"]}}
[junit4] 2> 303483 DEBUG (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_triggerEFRS]
[junit4] 2> 303483 INFO (ScheduledTrigger-772-thread-1) [n:127.0.0.1:41911_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 303483 DEBUG (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3be80239a8e99Tqv32djn0k4rzcgbaoiyw91y1",
[junit4] 2> "source":"node_added_triggerEFRS",
[junit4] 2> "eventTime":1053882492554905,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053882492554905],
[junit4] 2> "_enqueue_time_":1053892936523482,
[junit4] 2> "nodeNames":["127.0.0.1:36637_solr"]}}
[junit4] 2> 303483 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testEventFromRestoredState
[junit4] 2> 303484 DEBUG (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
[junit4] 2> 303484 DEBUG (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerEFRS after 5000ms
[junit4] 2> 303484 DEBUG (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=3be80239a8e99Tqv32djn0k4rzcgbaoiyw91y1
[junit4] 2> 303497 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testEventQueue
[junit4] 2> 303497 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 5
[junit4] 2> 303497 DEBUG (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 303497 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 303507 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 303508 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 303508 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 303509 INFO (qtp21819720-1994) [n:127.0.0.1:33895_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 303511 INFO (qtp21819720-1994) [n:127.0.0.1:33895_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 303515 INFO (qtp21819720-2056) [n:127.0.0.1:33895_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 303516 INFO (qtp7400942-2020) [n:127.0.0.1:36637_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 303517 INFO (qtp3213306-1938) [n:127.0.0.1:41911_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 303518 DEBUG (qtp21819720-1998) [n:127.0.0.1:33895_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 303518 INFO (qtp21819720-1998) [n:127.0.0.1:33895_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 303518 DEBUG (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 303519 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.TriggerIntegrationTest TestEventQueueAction instantiated
[junit4] 2> 303519 DEBUG (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:36637_solr, 127.0.0.1:33895_solr, 127.0.0.1:41911_solr]
[junit4] 2> 303519 DEBUG (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEQ instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestEventQueueAction}], enabled=true}
[junit4] 2> 303519 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 303520 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 303520 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 303520 DEBUG (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 303520 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEQ
[junit4] 2> 303520 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 303520 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 303522 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 303522 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 303523 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 303523 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1deacad{/solr,null,AVAILABLE}
[junit4] 2> 303523 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1d3958f{HTTP/1.1,[http/1.1]}{127.0.0.1:36365}
[junit4] 2> 303523 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.Server Started @305549ms
[junit4] 2> 303523 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36365}
[junit4] 2> 303523 ERROR (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 303524 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 303524 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 303524 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 303524 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T19:25:32.540Z
[junit4] 2> 303527 INFO (zkConnectionManagerCallback-471-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 303527 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 303534 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41123/solr
[junit4] 2> 303535 INFO (zkConnectionManagerCallback-475-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 303537 INFO (zkConnectionManagerCallback-477-thread-1-processing-n:127.0.0.1:36365_solr) [n:127.0.0.1:36365_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 303542 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36365_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 303544 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36365_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 303545 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36365_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36365_solr
[junit4] 2> 303546 INFO (zkCallback-466-thread-1-processing-n:127.0.0.1:36637_solr) [n:127.0.0.1:36637_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 303546 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 303547 INFO (zkCallback-448-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 303547 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 303547 INFO (zkCallback-476-thread-1-processing-n:127.0.0.1:36365_solr) [n:127.0.0.1:36365_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 303675 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36365_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36365.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 303685 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36365_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36365.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 303685 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36365_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36365.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@187a69c
[junit4] 2> 303687 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [n:127.0.0.1:36365_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001/tempDir-001/node5/.
[junit4] 2> 304520 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEQ
[junit4] 2> 304520 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 304520 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:36365_solr at time 1053893974398868
[junit4] 2> 305510 INFO (OverseerCollectionConfigSetProcessor-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 305521 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEQ
[junit4] 2> 305521 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 305521 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEQ firing registered processor for nodes: [127.0.0.1:36365_solr] added at times [1053893974398868], now=1053894975350959
[junit4] 2> 305521 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3",
[junit4] 2> "source":"node_added_triggerEQ",
[junit4] 2> "eventTime":1053893974398868,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053893974398868],
[junit4] 2> "nodeNames":["127.0.0.1:36365_solr"]}}
[junit4] 2> 305522 DEBUG (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_triggerEQ]
[junit4] 2> 305522 INFO (ScheduledTrigger-772-thread-3) [n:127.0.0.1:41911_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 305522 DEBUG (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3",
[junit4] 2> "source":"node_added_triggerEQ",
[junit4] 2> "eventTime":1053893974398868,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053893974398868],
[junit4] 2> "_enqueue_time_":1053894975479450,
[junit4] 2> "nodeNames":["127.0.0.1:36365_solr"]}}
[junit4] 2> 305522 INFO (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.TriggerIntegrationTest -- event: {
[junit4] 2> "id":"3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3",
[junit4] 2> "source":"node_added_triggerEQ",
[junit4] 2> "eventTime":1053893974398868,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053893974398868],
[junit4] 2> "_enqueue_time_":1053894975479450,
[junit4] 2> "nodeNames":["127.0.0.1:36365_solr"]}}
[junit4] 2> 305525 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1f7142f{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 305525 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=14950052
[junit4] 2> 305526 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 305526 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b0f39: rootName = solr_41911, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@da2c4b
[junit4] 2> 305534 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 305534 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17d94ec: rootName = solr_41911, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@13137f3
[junit4] 2> 305539 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 305539 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2a55e9: rootName = solr_41911, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2a79
[junit4] 2> 305540 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41911_solr
[junit4] 2> 305540 INFO (zkCallback-476-thread-1-processing-n:127.0.0.1:36365_solr) [n:127.0.0.1:36365_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 305541 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 305541 INFO (zkCallback-466-thread-1-processing-n:127.0.0.1:36637_solr) [n:127.0.0.1:36637_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 305541 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 305541 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 305541 INFO (zkCallback-448-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 305541 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.Overseer Overseer (id=72126660203184133-127.0.0.1:41911_solr-n_0000000001) closing
[junit4] 2> 305541 INFO (OverseerStateUpdate-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41911_solr
[junit4] 2> 305541 INFO (zkCallback-436-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 305542 WARN (OverseerAutoScalingTriggerThread-72126660203184133-127.0.0.1:41911_solr-n_0000000001) [n:127.0.0.1:41911_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 305542 WARN (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers Exception executing actions
[junit4] 2> org.apache.lucene.store.AlreadyClosedException: ScheduledTrigger node_added_triggerEQ has been closed.
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers$ScheduledTrigger.dequeue(ScheduledTriggers.java:526)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:310)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 305543 DEBUG (AutoscalingActionExecutor-773-thread-1-processing-n:127.0.0.1:41911_solr) [n:127.0.0.1:41911_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 20 ms for event id=3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3
[junit4] 2> 305543 DEBUG (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 305543 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33895_solr
[junit4] 2> 305544 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5526b1{/solr,null,UNAVAILABLE}
[junit4] 2> 305544 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 305544 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.Overseer Overseer (id=72126660203184139-127.0.0.1:33895_solr-n_0000000002) starting
[junit4] 2> 305551 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 305551 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 305551 INFO (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.TriggerIntegrationTest TestEventQueueAction instantiated
[junit4] 2> 305551 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:36637_solr, 127.0.0.1:36365_solr, 127.0.0.1:33895_solr]
[junit4] 2> 305552 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEQ instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestEventQueueAction}], enabled=true}
[junit4] 2> 305552 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36637_solr, 127.0.0.1:36365_solr, 127.0.0.1:33895_solr]
[junit4] 2> 305552 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion -1
[junit4] 2> 305552 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 305553 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 305553 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 305553 DEBUG (ScheduledTrigger-783-thread-1) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 305554 DEBUG (ScheduledTrigger-783-thread-2) [n:127.0.0.1:33895_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3",
[junit4] 2> "source":"node_added_triggerEQ",
[junit4] 2> "eventTime":1053893974398868,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053893974398868],
[junit4] 2> "_dequeue_time_":1053895007295575,
[junit4] 2> "_enqueue_time_":1053894975479450,
[junit4] 2> "nodeNames":["127.0.0.1:36365_solr"],
[junit4] 2> "replaying":true}}
[junit4] 2> 305554 DEBUG (ScheduledTrigger-783-thread-2) [n:127.0.0.1:33895_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_triggerEQ]
[junit4] 2> 305554 INFO (ScheduledTrigger-783-thread-2) [n:127.0.0.1:33895_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 305554 DEBUG (AutoscalingActionExecutor-784-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3",
[junit4] 2> "source":"node_added_triggerEQ",
[junit4] 2> "eventTime":1053893974398868,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053893974398868],
[junit4] 2> "_dequeue_time_":1053895007295575,
[junit4] 2> "_enqueue_time_":1053894975479450,
[junit4] 2> "nodeNames":["127.0.0.1:36365_solr"],
[junit4] 2> "replaying":true}}
[junit4] 2> 305554 INFO (AutoscalingActionExecutor-784-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.a.TriggerIntegrationTest -- event: {
[junit4] 2> "id":"3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3",
[junit4] 2> "source":"node_added_triggerEQ",
[junit4] 2> "eventTime":1053893974398868,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1053893974398868],
[junit4] 2> "_dequeue_time_":1053895007295575,
[junit4] 2> "_enqueue_time_":1053894975479450,
[junit4] 2> "nodeNames":["127.0.0.1:36365_solr"],
[junit4] 2> "replaying":true}}
[junit4] 2> 305555 DEBUG (ScheduledTrigger-783-thread-2) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEQ
[junit4] 2> 305555 DEBUG (ScheduledTrigger-783-thread-2) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 305555 DEBUG (AutoscalingActionExecutor-784-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
[junit4] 2> 305558 DEBUG (AutoscalingActionExecutor-784-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerEQ after 5000ms
[junit4] 2> 305558 DEBUG (AutoscalingActionExecutor-784-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 4 ms for event id=3be82cff99794Tqv32djn0k4rzcgbaoiyw91y3
[junit4] 2> 310545 INFO (TEST-TriggerIntegrationTest.testEventQueue-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testEventQueue
[junit4] 2> 310556 DEBUG (ScheduledTrigger-783-thread-3) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 310559 DEBUG (ScheduledTrigger-783-thread-1) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEQ
[junit4] 2> 310559 DEBUG (ScheduledTrigger-783-thread-1) [n:127.0.0.1:33895_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 310561 INFO (TEST-TriggerIntegrationTest.testMetricTrigger-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMetricTrigger
[junit4] 2> 310561 INFO (TEST-TriggerIntegrationTest.testMetricTrigger-seed#[BA7A5B25EDBC89F3]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 8
[junit4] 2> 310562 DEBUG (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 310562 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 310562 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 310562 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 310562 DEBUG (OverseerAutoScalingTriggerThread-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 310563 INFO (zkConnectionManagerCallback-481-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 310566 INFO (qtp21819720-2000) [n:127.0.0.1:33895_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=testMetricTrigger&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 310567 INFO (OverseerThreadFactory-785-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testMetricTrigger
[junit4] 2> 310671 INFO (OverseerStateUpdate-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testMetricTrigger",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testMetricTrigger_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33895/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 310672 INFO (OverseerStateUpdate-72126660203184139-127.0.0.1:33895_solr-n_0000000002) [n:127.0.0.1:33895_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testMetricTrigger",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testMetricTrigger_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36365/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 310874 INFO (qtp21819720-2055) [n:127.0.0.1:33895_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n1&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 310875 INFO (qtp21819720-2055) [n:127.0.0.1:33895_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 310881 INFO (qtp13598783-2061) [n:127.0.0.1:36365_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n2&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 310881 INFO (qtp13598783-2061) [n:127.0.0.1:36365_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 310985 INFO (zkCallback-476-thread-1-processing-n:127.0.0.1:36365_solr) [n:127.0.0.1:36365_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [3])
[junit4] 2> 310985 INFO (zkCallback-456-thread-1-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [3])
[junit4] 2> 310985 INFO (zkCallback-456-thread-2-processing-n:127.0.0.1:33895_solr) [n:127.0.0.1:33895_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [3])
[junit4] 2> 310985 INFO (zkCallback-476-thread-2-processing-n:127.0.0.1:36365_solr) [n:127.0.0.1:36365_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [3])
[junit4] 2> 311897 INFO (qtp13598783-2061) [n:127.0.0.1:36365_solr c:testMetricTrigger s:shard2 r:core_node4 x:testMetricTrigger_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 311939 INFO (qtp21819720-2055) [n:127.0.0.1:33895_solr c:testMetricTrigger s:shard1 r:core_nod
[...truncated too long message...]
thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@dcf3b0{/solr,null,UNAVAILABLE}
[junit4] 2> 474576 INFO (jetty-closer-421-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 474591 INFO (coreCloseExecutor-952-thread-2) [n:127.0.0.1:36511_solr c:collection1 s:shard1 r:core_node16 x:collection1_shard1_replica_n15] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n15, tag=13185056
[junit4] 2> 474591 INFO (coreCloseExecutor-952-thread-2) [n:127.0.0.1:36511_solr c:collection1 s:shard1 r:core_node16 x:collection1_shard1_replica_n15] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5c3e7b: rootName = solr_36511, domain = solr.core.collection1.shard1.replica_n15, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n15 / com.codahale.metrics.MetricRegistry@ba96d6
[junit4] 2> 474603 INFO (coreCloseExecutor-953-thread-1) [n:127.0.0.1:37455_solr c:collection1 s:shard1 r:core_node12 x:collection1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=4096098
[junit4] 2> 474603 INFO (coreCloseExecutor-954-thread-1) [n:127.0.0.1:40809_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=14992727
[junit4] 2> 474604 INFO (coreCloseExecutor-955-thread-1) [n:127.0.0.1:39059_solr c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=17307382
[junit4] 2> 474604 INFO (coreCloseExecutor-957-thread-1) [n:127.0.0.1:34613_solr c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=20697933
[junit4] 2> 474606 INFO (jetty-closer-421-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72126660203184152-127.0.0.1:34613_solr-n_0000000006) closing
[junit4] 2> 474607 INFO (OverseerStateUpdate-72126660203184152-127.0.0.1:34613_solr-n_0000000006) [n:127.0.0.1:34613_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34613_solr
[junit4] 2> 474608 WARN (OverseerAutoScalingTriggerThread-72126660203184152-127.0.0.1:34613_solr-n_0000000006) [n:127.0.0.1:34613_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 474610 DEBUG (jetty-closer-421-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 474610 INFO (jetty-closer-421-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@65bab0{/solr,null,UNAVAILABLE}
[junit4] 2> 474610 INFO (jetty-closer-421-thread-4) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 474608 INFO (coreCloseExecutor-958-thread-1) [n:127.0.0.1:45791_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=4818845
[junit4] 2> 474610 INFO (jetty-closer-421-thread-6) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1e7e3f3{/solr,null,UNAVAILABLE}
[junit4] 2> 474610 INFO (jetty-closer-421-thread-6) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 474612 INFO (zkCallback-570-thread-2-processing-n:127.0.0.1:45791_solr) [n:127.0.0.1:45791_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45791_solr
[junit4] 2> 474613 INFO (jetty-closer-421-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@170b776{/solr,null,UNAVAILABLE}
[junit4] 2> 474613 INFO (jetty-closer-421-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 474614 INFO (jetty-closer-421-thread-8) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@c2fd4d{/solr,null,UNAVAILABLE}
[junit4] 2> 474614 INFO (jetty-closer-421-thread-8) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 474615 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1003ed0b83f002d, likely client has closed socket
[junit4] 2> 474615 INFO (zkCallback-590-thread-1-processing-n:127.0.0.1:36511_solr) [n:127.0.0.1:36511_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36511_solr
[junit4] 2> 474615 INFO (coreCloseExecutor-952-thread-1) [n:127.0.0.1:36511_solr c:collection1 s:shard1 r:core_node14 x:collection1_shard1_replica_n13] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=9605266
[junit4] 2> 474615 INFO (coreCloseExecutor-952-thread-2) [n:127.0.0.1:36511_solr c:collection1 s:shard1 r:core_node16 x:collection1_shard1_replica_n15] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=13185056
[junit4] 2> 474617 INFO (jetty-closer-421-thread-9) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a7727{/solr,null,UNAVAILABLE}
[junit4] 2> 474617 INFO (jetty-closer-421-thread-9) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 476115 INFO (jetty-closer-421-thread-7) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1829a7a{/solr,null,UNAVAILABLE}
[junit4] 2> 476115 INFO (jetty-closer-421-thread-7) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 476116 ERROR (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 476116 INFO (SUITE-TriggerIntegrationTest-seed#[BA7A5B25EDBC89F3]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41123 41123
[junit4] 2> 481834 INFO (Thread-465) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41123 41123
[junit4] 2> 481836 WARN (Thread-465) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/collections/collection1/terms/shard1
[junit4] 2> 19 /solr/clusterprops.json
[junit4] 2> 19 /solr/aliases.json
[junit4] 2> 18 /solr/security.json
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 9 /solr/collections/testMetricTrigger/terms/shard1
[junit4] 2> 2 /solr/collections/testMetricTrigger/terms/shard2
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 101 /solr/collections/collection1/state.json
[junit4] 2> 36 /solr/collections/testMetricTrigger/state.json
[junit4] 2> 19 /solr/clusterstate.json
[junit4] 2> 6 /solr/autoscaling.json
[junit4] 2> 3 /solr/overseer_elect/election/72126660203184161-127.0.0.1:39059_solr-n_0000000009
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard1/election/72126660203184173-core_node3-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72126660203184161-core_node8-n_0000000003
[junit4] 2> 2 /solr/overseer_elect/election/72126660203184142-127.0.0.1:36637_solr-n_0000000003
[junit4] 2> 2 /solr/overseer_elect/election/72126660203184167-127.0.0.1:40809_solr-n_0000000011
[junit4] 2> 2 /solr/overseer_elect/election/72126660203184173-127.0.0.1:45791_solr-n_0000000013
[junit4] 2> 2 /solr/overseer_elect/election/72126660203184152-127.0.0.1:34613_solr-n_0000000006
[junit4] 2> 2 /solr/overseer_elect/election/72126660203184155-127.0.0.1:45527_solr-n_0000000007
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 19 /solr/live_nodes
[junit4] 2> 19 /solr/collections
[junit4] 2> 6 /solr/overseer/queue-work
[junit4] 2> 6 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 6 /solr/overseer/queue
[junit4] 2> 6 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_triggerMR
[junit4] 2> 2 /solr/autoscaling/events/node_added_triggerCTOOR
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_BA7A5B25EDBC89F3-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=PostingsFormat(name=Direct), id=Lucene50(blocksize=128), x_s=PostingsFormat(name=Memory)}, docValues:{_version_=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=595, maxMBSortInHeap=5.025671998387754, sim=RandomSimilarity(queryNorm=true): {}, locale=de-LU, timezone=Africa/El_Aaiun
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=49505472,total=162803712
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrCoreParser, TestGraphMLResponseWriter, RequiredFieldsTest, TestPayloadCheckQParserPlugin, TestPullReplicaErrorHandling, UpdateRequestProcessorFactoryTest, TestNumericTerms64, TestRebalanceLeaders, TestSystemIdResolver, RestartWhileUpdatingTest, OverriddenZkACLAndCredentialsProvidersTest, SolrCoreTest, TestDistributedGrouping, TestManagedSynonymGraphFilterFactory, BasicFunctionalityTest, TestSegmentSorting, TestFuzzyAnalyzedSuggestions, OverseerRolesTest, TestConfigSetsAPIExclusivity, TestReplicationHandlerBackup, JsonLoaderTest, TriggerIntegrationTest]
[junit4] Completed [93/775 (1!)] on J1 in 205.35s, 14 tests, 1 failure <<< FAILURES!
[...truncated 46264 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1330
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1330/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseG1GC
6 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=11433, name=jetty-launcher-2644-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=11437, name=jetty-launcher-2644-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=11433, name=jetty-launcher-2644-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=11437, name=jetty-launcher-2644-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
at __randomizedtesting.SeedInfo.seed([BD70D0B9EC0D351A]:0)
FAILED: org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest.testSimple
Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:43375_solr, 127.0.0.1:43751_solr] Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/17)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node3":{ "dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data/", "base_url":"http://127.0.0.1:43375/solr", "node_name":"127.0.0.1:43375_solr", "type":"NRT", "ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data/tlog", "core":"testSimple1_shard1_replica_n1", "shared_storage":"true", "state":"active"}, "core_node5":{ "dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data/", "base_url":"http://127.0.0.1:43375/solr", "node_name":"127.0.0.1:43375_solr", "type":"NRT", "ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data/tlog", "core":"testSimple1_shard1_replica_n2", "shared_storage":"true", "state":"active", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node7":{ "dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data/", "base_url":"http://127.0.0.1:35725/solr", "node_name":"127.0.0.1:35725_solr", "type":"NRT", "ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data/tlog", "core":"testSimple1_shard2_replica_n4", "shared_storage":"true", "state":"down"}, "core_node8":{ "dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data/", "base_url":"http://127.0.0.1:43375/solr", "node_name":"127.0.0.1:43375_solr", "type":"NRT", "ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data/tlog", "core":"testSimple1_shard2_replica_n6", "shared_storage":"true", "state":"active", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"true", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:43375_solr, 127.0.0.1:43751_solr]
Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/17)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node3":{
"dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data/",
"base_url":"http://127.0.0.1:43375/solr",
"node_name":"127.0.0.1:43375_solr",
"type":"NRT",
"ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data/tlog",
"core":"testSimple1_shard1_replica_n1",
"shared_storage":"true",
"state":"active"},
"core_node5":{
"dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data/",
"base_url":"http://127.0.0.1:43375/solr",
"node_name":"127.0.0.1:43375_solr",
"type":"NRT",
"ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data/tlog",
"core":"testSimple1_shard1_replica_n2",
"shared_storage":"true",
"state":"active",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node7":{
"dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data/",
"base_url":"http://127.0.0.1:35725/solr",
"node_name":"127.0.0.1:35725_solr",
"type":"NRT",
"ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data/tlog",
"core":"testSimple1_shard2_replica_n4",
"shared_storage":"true",
"state":"down"},
"core_node8":{
"dataDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data/",
"base_url":"http://127.0.0.1:43375/solr",
"node_name":"127.0.0.1:43375_solr",
"type":"NRT",
"ulogDir":"hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data/tlog",
"core":"testSimple1_shard2_replica_n6",
"shared_storage":"true",
"state":"active",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"true",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([BD70D0B9EC0D351A:85C3F447CBFEE1CB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at __randomizedtesting.SeedInfo.seed([BD70D0B9EC0D351A:74C59217E56AF3EF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:713)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([BD70D0B9EC0D351A:B98E79ABD6C7B780]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTrigger(TriggerIntegrationTest.java:521)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([BD70D0B9EC0D351A:77CE736B3E5E355]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.junit.Assert.assertNull(Assert.java:562)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([BD70D0B9EC0D351A:D08C74445645CA1D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:265)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12798 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/init-core-data-001
[junit4] 2> 723312 WARN (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 723313 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 723314 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 723314 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 723315 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001
[junit4] 2> 723315 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 723315 INFO (Thread-1200) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 723315 INFO (Thread-1200) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 723317 ERROR (Thread-1200) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 723415 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34359
[junit4] 2> 723418 INFO (zkConnectionManagerCallback-1274-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723422 INFO (jetty-launcher-1271-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 723422 INFO (jetty-launcher-1271-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 723422 INFO (jetty-launcher-1271-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-3) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 723423 INFO (jetty-launcher-1271-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 723427 INFO (jetty-launcher-1271-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1854714{/solr,null,AVAILABLE}
[junit4] 2> 723427 INFO (jetty-launcher-1271-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14d5f89{/solr,null,AVAILABLE}
[junit4] 2> 723427 INFO (jetty-launcher-1271-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1312abc{/solr,null,AVAILABLE}
[junit4] 2> 723432 INFO (jetty-launcher-1271-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@eba0c0{HTTP/1.1,[http/1.1]}{127.0.0.1:43375}
[junit4] 2> 723432 INFO (jetty-launcher-1271-thread-1) [ ] o.e.j.s.Server Started @725182ms
[junit4] 2> 723432 INFO (jetty-launcher-1271-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43375}
[junit4] 2> 723432 ERROR (jetty-launcher-1271-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 723432 INFO (jetty-launcher-1271-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 723432 INFO (jetty-launcher-1271-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 723432 INFO (jetty-launcher-1271-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 723432 INFO (jetty-launcher-1271-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T15:33:16.511Z
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6d4497{HTTP/1.1,[http/1.1]}{127.0.0.1:43751}
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1a285ee{HTTP/1.1,[http/1.1]}{127.0.0.1:35725}
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-3) [ ] o.e.j.s.Server Started @725183ms
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-2) [ ] o.e.j.s.Server Started @725183ms
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43751}
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35725}
[junit4] 2> 723433 ERROR (jetty-launcher-1271-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 723433 ERROR (jetty-launcher-1271-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T15:33:16.512Z
[junit4] 2> 723433 INFO (jetty-launcher-1271-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T15:33:16.512Z
[junit4] 2> 723443 INFO (zkConnectionManagerCallback-1276-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723443 INFO (zkConnectionManagerCallback-1280-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723443 INFO (jetty-launcher-1271-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 723443 INFO (jetty-launcher-1271-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 723447 INFO (zkConnectionManagerCallback-1278-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723450 INFO (jetty-launcher-1271-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 723456 INFO (jetty-launcher-1271-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34359/solr
[junit4] 2> 723456 INFO (jetty-launcher-1271-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34359/solr
[junit4] 2> 723456 INFO (jetty-launcher-1271-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34359/solr
[junit4] 2> 723458 INFO (zkConnectionManagerCallback-1286-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723459 INFO (zkConnectionManagerCallback-1292-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723459 INFO (zkConnectionManagerCallback-1290-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723460 INFO (zkConnectionManagerCallback-1296-thread-1-processing-n:127.0.0.1:43375_solr) [n:127.0.0.1:43375_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723460 INFO (zkConnectionManagerCallback-1298-thread-1-processing-n:127.0.0.1:35725_solr) [n:127.0.0.1:35725_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723464 INFO (zkConnectionManagerCallback-1294-thread-1-processing-n:127.0.0.1:43751_solr) [n:127.0.0.1:43751_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723499 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 723499 INFO (jetty-launcher-1271-thread-1) [n:127.0.0.1:43375_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 723499 INFO (jetty-launcher-1271-thread-2) [n:127.0.0.1:35725_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 723500 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43751_solr
[junit4] 2> 723500 INFO (jetty-launcher-1271-thread-1) [n:127.0.0.1:43375_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43375_solr
[junit4] 2> 723500 INFO (jetty-launcher-1271-thread-2) [n:127.0.0.1:35725_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35725_solr
[junit4] 2> 723500 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.c.Overseer Overseer (id=72125748648869895-127.0.0.1:43751_solr-n_0000000000) starting
[junit4] 2> 723504 INFO (zkCallback-1295-thread-1-processing-n:127.0.0.1:43375_solr) [n:127.0.0.1:43375_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 723504 INFO (zkCallback-1297-thread-1-processing-n:127.0.0.1:35725_solr) [n:127.0.0.1:35725_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 723504 INFO (zkCallback-1293-thread-1-processing-n:127.0.0.1:43751_solr) [n:127.0.0.1:43751_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 723512 DEBUG (OverseerAutoScalingTriggerThread-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 723512 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43751_solr
[junit4] 2> 723512 DEBUG (OverseerAutoScalingTriggerThread-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 723513 INFO (zkCallback-1297-thread-1-processing-n:127.0.0.1:35725_solr) [n:127.0.0.1:35725_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 723513 INFO (zkCallback-1295-thread-1-processing-n:127.0.0.1:43375_solr) [n:127.0.0.1:43375_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 723515 DEBUG (OverseerAutoScalingTriggerThread-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:43375_solr, 127.0.0.1:35725_solr]
[junit4] 2> 723515 INFO (zkCallback-1293-thread-1-processing-n:127.0.0.1:43751_solr) [n:127.0.0.1:43751_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 723515 DEBUG (OverseerAutoScalingTriggerThread-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 723515 DEBUG (OverseerAutoScalingTriggerThread-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 723516 DEBUG (OverseerAutoScalingTriggerThread-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 723516 DEBUG (OverseerAutoScalingTriggerThread-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 723516 DEBUG (ScheduledTrigger-2308-thread-1) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 723587 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43751.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723594 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43751.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723594 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43751.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723595 INFO (jetty-launcher-1271-thread-3) [n:127.0.0.1:43751_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001/node3/.
[junit4] 2> 723609 INFO (jetty-launcher-1271-thread-1) [n:127.0.0.1:43375_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43375.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723618 INFO (jetty-launcher-1271-thread-1) [n:127.0.0.1:43375_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43375.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723619 INFO (jetty-launcher-1271-thread-1) [n:127.0.0.1:43375_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43375.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723620 INFO (jetty-launcher-1271-thread-1) [n:127.0.0.1:43375_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001/node1/.
[junit4] 2> 723625 INFO (jetty-launcher-1271-thread-2) [n:127.0.0.1:35725_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35725.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723632 INFO (jetty-launcher-1271-thread-2) [n:127.0.0.1:35725_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35725.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723632 INFO (jetty-launcher-1271-thread-2) [n:127.0.0.1:35725_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35725.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 723633 INFO (jetty-launcher-1271-thread-2) [n:127.0.0.1:35725_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001/node2/.
[junit4] 2> 723670 INFO (zkConnectionManagerCallback-1306-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723672 INFO (zkConnectionManagerCallback-1310-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 723672 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 723673 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34359/solr ready
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 724517 DEBUG (ScheduledTrigger-2308-thread-1) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 724547 WARN (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 724701 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 724718 WARN (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 724775 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 724821 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_37339_hdfs____.huuss1/webapp
[junit4] 2> 725518 DEBUG (ScheduledTrigger-2308-thread-2) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 726131 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:37339
[junit4] 2> 726523 DEBUG (ScheduledTrigger-2308-thread-1) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 726884 WARN (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 726887 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 726898 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_33523_datanode____.c7y4oz/webapp
[junit4] 2> 727383 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33523
[junit4] 2> 727523 DEBUG (ScheduledTrigger-2308-thread-1) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 727719 WARN (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 727720 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 727741 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37115_datanode____.505s2w/webapp
[junit4] 2> 728323 INFO (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[BD70D0B9EC0D351A]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37115
[junit4] 2> 728445 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost.localdomain/127.0.0.1:34519) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 728523 DEBUG (ScheduledTrigger-2308-thread-1) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 728563 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost.localdomain/127.0.0.1:34519) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 728613 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x3b1d70c76278b: from storage DS-921925c2-a303-45b9-8577-c1b4ffc7470b node DatanodeRegistration(127.0.0.1:42825, datanodeUuid=a202db95-face-4750-80dc-d4d7de20220f, infoPort=46171, infoSecurePort=0, ipcPort=37321, storageInfo=lv=-56;cid=testClusterID;nsid=1706270931;c=0), blocks: 0, hasStaleStorage: true, processing time: 3 msecs
[junit4] 2> 728614 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x3b1d70c8167cb: from storage DS-cd1f2f14-9e70-4288-aa8d-936350e85596 node DatanodeRegistration(127.0.0.1:36307, datanodeUuid=5b6a8a1b-6197-447e-b996-4b3a9ef730cc, infoPort=36415, infoSecurePort=0, ipcPort=38935, storageInfo=lv=-56;cid=testClusterID;nsid=1706270931;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 728614 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x3b1d70c76278b: from storage DS-8006174e-e815-43e9-b68d-a50317d638e2 node DatanodeRegistration(127.0.0.1:42825, datanodeUuid=a202db95-face-4750-80dc-d4d7de20220f, infoPort=46171, infoSecurePort=0, ipcPort=37321, storageInfo=lv=-56;cid=testClusterID;nsid=1706270931;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 728614 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x3b1d70c8167cb: from storage DS-f772c04c-53aa-4246-874e-542bab24c33a node DatanodeRegistration(127.0.0.1:36307, datanodeUuid=5b6a8a1b-6197-447e-b996-4b3a9ef730cc, infoPort=36415, infoSecurePort=0, ipcPort=38935, storageInfo=lv=-56;cid=testClusterID;nsid=1706270931;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 729026 INFO (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[BD70D0B9EC0D351A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
[junit4] 2> 729028 INFO (qtp30030634-6456) [n:127.0.0.1:43375_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:43751_solr,127.0.0.1:43375_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 729029 INFO (OverseerThreadFactory-2310-thread-1-processing-n:127.0.0.1:43751_solr) [n:127.0.0.1:43751_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testSimple1
[junit4] 2> 729133 INFO (OverseerStateUpdate-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43751/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 729135 INFO (OverseerStateUpdate-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43375/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 729136 INFO (OverseerStateUpdate-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43751/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 729137 INFO (OverseerStateUpdate-72125748648869895-127.0.0.1:43751_solr-n_0000000000) [n:127.0.0.1:43751_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43375/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 729340 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 729340 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 729340 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 729341 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 729343 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 729343 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 729446 INFO (zkCallback-1295-thread-1-processing-n:127.0.0.1:43375_solr) [n:127.0.0.1:43375_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 729446 INFO (zkCallback-1293-thread-1-processing-n:127.0.0.1:43751_solr) [n:127.0.0.1:43751_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 729446 INFO (zkCallback-1293-thread-2-processing-n:127.0.0.1:43751_solr) [n:127.0.0.1:43751_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 729446 INFO (zkCallback-1295-thread-2-processing-n:127.0.0.1:43375_solr) [n:127.0.0.1:43375_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 729524 DEBUG (ScheduledTrigger-2308-thread-1) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 730354 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 730354 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 730354 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 730354 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 730361 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 730361 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
[junit4] 2> 730361 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
[junit4] 2> 730388 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 730388 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 730388 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
[junit4] 2> 730388 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
[junit4] 2> 730388 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 730388 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
[junit4] 2> 730388 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43751.solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 730388 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43751.solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 730389 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43375.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 730389 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
[junit4] 2> 730390 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 730390 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
[junit4] 2> 730391 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43375.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@aab2a3
[junit4] 2> 730405 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:34519/data
[junit4] 2> 730405 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:34519/data
[junit4] 2> 730405 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:34519/data
[junit4] 2> 730406 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 730406 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 730406 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 730406 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 730405 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:34519/data
[junit4] 2> 730406 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 730407 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 730407 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 730407 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001/node1/testSimple1_shard2_replica_n6], dataDir=[hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data/]
[junit4] 2> 730407 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 730407 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001/node3/testSimple1_shard2_replica_n4], dataDir=[hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data/]
[junit4] 2> 730407 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001/node1/testSimple1_shard1_replica_n2], dataDir=[hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data/]
[junit4] 2> 730407 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_BD70D0B9EC0D351A-001/tempDir-001/node3/testSimple1_shard1_replica_n1], dataDir=[hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data/]
[junit4] 2> 730410 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data/snapshot_metadata
[junit4] 2> 730410 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data/snapshot_metadata
[junit4] 2> 730410 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data/snapshot_metadata
[junit4] 2> 730410 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data/snapshot_metadata
[junit4] 2> 730524 DEBUG (ScheduledTrigger-2308-thread-1) [n:127.0.0.1:43751_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 730546 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data
[junit4] 2> 730546 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data
[junit4] 2> 730548 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data
[junit4] 2> 730548 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data
[junit4] 2> 730606 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node8/data/index
[junit4] 2> 730606 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node5/data/index
[junit4] 2> 730606 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node3/data/index
[junit4] 2> 730607 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:34519/data/testSimple1/core_node7/data/index
[junit4] 2> 730880 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42825 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-cd1f2f14-9e70-4288-aa8d-936350e85596:NORMAL:127.0.0.1:36307|RBW], ReplicaUC[[DISK]DS-8006174e-e815-43e9-b68d-a50317d638e2:NORMAL:127.0.0.1:42825|RBW]]} size 69
[junit4] 2> 730881 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36307 is added to blk_1073741828_1004{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-8006174e-e815-43e9-b68d-a50317d638e2:NORMAL:127.0.0.1:42825|RBW], ReplicaUC[[DISK]DS-cd1f2f14-9e70-4288-aa8d-936350e85596:NORMAL:127.0.0.1:36307|RBW]]} size 69
[junit4] 2> 730881 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36307 is added to blk_1073741825_1001 size 69
[junit4] 2> 730881 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36307 is added to blk_1073741827_1003{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-921925c2-a303-45b9-8577-c1b4ffc7470b:NORMAL:127.0.0.1:42825|RBW], ReplicaUC[[DISK]DS-cd1f2f14-9e70-4288-aa8d-936350e85596:NORMAL:127.0.0.1:36307|RBW]]} size 69
[junit4] 2> 730881 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36307 is added to blk_1073741826_1002{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-f772c04c-53aa-4246-874e-542bab24c33a:NORMAL:127.0.0.1:36307|RBW], ReplicaUC[[DISK]DS-8006174e-e815-43e9-b68d-a50317d638e2:NORMAL:127.0.0.1:42825|RBW]]} size 69
[junit4] 2> 730881 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42825 is added to blk_1073741827_1003 size 69
[junit4] 2> 730881 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42825 is added to blk_1073741826_1002 size 69
[junit4] 2> 730881 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42825 is added to blk_1073741828_1004 size 69
[junit4] 2> 731369 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 731369 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 731369 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 731369 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 731369 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 731370 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 731370 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 731369 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 731370 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 731373 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 731373 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 731373 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 731386 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 731386 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 731386 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 731386 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 731386 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 731386 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 731388 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 731388 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 731478 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@435ec7[testSimple1_shard1_replica_n1] main]
[junit4] 2> 731479 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d1c1d6[testSimple1_shard2_replica_n4] main]
[junit4] 2> 731479 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f2ef7a[testSimple1_shard1_replica_n2] main]
[junit4] 2> 731479 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@a169ea[testSimple1_shard2_replica_n6] main]
[junit4] 2> 731480 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 731480 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 731480 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 731480 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 731481 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 731481 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 731481 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 731481 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 731483 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 731483 INFO (qtp30030634-6741) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 731483 INFO (qtp22274327-6465) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 731483 INFO (searcherExecutor-2318-thread-1-processing-n:127.0.0.1:43751_solr x:testSimple1_shard1_replica_n1 s:shard1 c:testSimple1 r:core_node3) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [testSimple1_shard1_replica_n1] Registered new searcher Searcher@435ec7[testSimple1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 731483 INFO (searcherExecutor-2319-thread-1-processing-n:127.0.0.1:43751_solr x:testSimple1_shard2_replica_n4 s:shard2 c:testSimple1 r:core_node7) [n:127.0.0.1:43751_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [testSimple1_shard2_replica_n4] Registered new searcher Searcher@1d1c1d6[testSimple1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 731483 INFO (searcherExecutor-2320-thread-1-processing-n:127.0.0.1:43375_solr x:testSimple1_shard1_replica_n2 s:shard1 c:testSimple1 r:core_node5) [n:127.0.0.1:43375_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [testSimple1_shard1_replica_n2] Registered new searcher Searcher@1f2ef7a[testSimple1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 731484 INFO (qtp30030634-6459) [n:127.0.0.1:43375_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 731485 INFO (qtp22274327-6739) [n:127.0.0.1:43751_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max versio
[...truncated too long message...]
run(ClientCnxn.java:506)
[junit4] 2> 1531431 ERROR (jetty-launcher-2644-thread-1-EventThread) [n:127.0.0.1:46409_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> Feb 10, 2018 3:46:44 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=159, maxMBSortInHeap=7.936215099769971, sim=RandomSimilarity(queryNorm=false): {}, locale=en-PH, timezone=America/Maceio
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=355362184,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestLeaderInitiatedRecoveryThread, HdfsBasicDistributedZkTest, TestJsonFacets, TestXmlQParserPlugin, TestFieldCollectionResource, BlockJoinFacetRandomTest, TestLegacyNumericUtils, TestMultiWordSynonyms, TestReplicaProperties, BasicZkTest, JavabinLoaderTest, QueryElevationComponentTest, SliceStateTest, StressHdfsTest, SOLR749Test, QueryParsingTest, TestLRUCache, ClassificationUpdateProcessorFactoryTest, CreateRoutedAliasTest, TestSlowCompositeReaderWrapper, TestConfigReload, CdcrReplicationDistributedZkTest, PrimitiveFieldTypeTest, TestPolicyCloud, SolrCoreMetricManagerTest, TestNumericTerms64, ConjunctionSolrSpellCheckerTest, TestFieldCacheWithThreads, SubstringBytesRefFilterTest, TestStreamBody, ZkStateWriterTest, TestEmbeddedSolrServerAdminHandler, TestManagedSynonymGraphFilterFactory, SystemInfoHandlerTest, DirectUpdateHandlerOptimizeTest, CollectionTooManyReplicasTest, DOMUtilTest, SoftAutoCommitTest, TestOnReconnectListenerSupport, LegacyCloudClusterPropTest, TestConfigSetImmutable, ZkControllerTest, TestFieldCacheSort, PathHierarchyTokenizerFactoryTest, AsyncCallRequestStatusResponseTest, TestExceedMaxTermLength, AlternateDirectoryTest, TestCloudPivotFacet, OverseerRolesTest, TestCursorMarkWithoutUniqueKey, TestCollapseQParserPlugin, SaslZkACLProviderTest, BaseCdcrDistributedZkTest, TestFastLRUCache, TestManagedResourceStorage, TestZkChroot, TestPullReplicaErrorHandling, TestCopyFieldCollectionResource, TestRebalanceLeaders, FacetPivotSmallTest, CustomHighlightComponentTest, TestSweetSpotSimilarityFactory, RestartWhileUpdatingTest, TestRTGBase, HighlighterTest, DocValuesNotIndexedTest, TestElisionMultitermQuery, TolerantUpdateProcessorTest, ParsingFieldUpdateProcessorsTest, BigEndianAscendingWordSerializerTest, PeerSyncReplicationTest, TestPartialUpdateDeduplication, TestCollectionAPIs, SolrInfoBeanTest, TestSystemIdResolver, ZkShardTermsTest, TestSearchPerf, TestDistributedGrouping, OverseerTest, ShardRoutingCustomTest, TriLevelCompositeIdRoutingTest, DocumentBuilderTest, SparseHLLTest, AddReplicaTest, TestCloudSearcherWarming, TestRecovery, ChaosMonkeySafeLeaderTest, TestRawResponseWriter, TestBM25SimilarityFactory, AddSchemaFieldsUpdateProcessorFactoryTest, DistributedIntervalFacetingTest, TestFoldingMultitermQuery, DistributedQueryComponentCustomSortTest, TestStressRecovery, TriggerIntegrationTest, TestRTimerTree, PeerSyncTest, MetricsHandlerTest, TestSortByMinMaxFunction, TestCollectionsAPIViaSolrCloudCluster, TestUniqueKeyFieldResource, ResourceLoaderTest, TestPerFieldSimilarity, TestPostingsSolrHighlighter, TestXIncludeConfig, ExecutePlanActionTest, SimpleMLTQParserTest, BufferStoreTest, LoggingHandlerTest, MetricTriggerTest, JsonLoaderTest, TestNumericRangeQuery32, TestDefaultStatsCache, SortByFunctionTest, TestDelegationWithHadoopAuth, TestJettySolrRunner, TestCustomDocTransformer, TestNonDefinedSimilarityFactory, DistributedFacetPivotSmallAdvancedTest, ShufflingReplicaListTransformerTest, TestCustomSort, FullHLLTest, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=BD70D0B9EC0D351A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-PH -Dtests.timezone=America/Maceio -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=11433, name=jetty-launcher-2644-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > 2) Thread[id=11437, name=jetty-launcher-2644-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > at __randomizedtesting.SeedInfo.seed([BD70D0B9EC0D351A]:0)
[junit4] Completed [358/775 (4!)] on J1 in 49.97s, 12 tests, 1 error <<< FAILURES!
[...truncated 45341 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1329
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1329/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseG1GC
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.rule.RulesTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.rule.RulesTest: 1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.rule.RulesTest:
1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([EBBA7F4A24CDA47F]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.rule.RulesTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([EBBA7F4A24CDA47F]:0)
FAILED: org.apache.solr.cloud.ReplaceNodeNoTargetTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([EBBA7F4A24CDA47F:63EE40908A31C987]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections
Error Message:
The operations computed by ComputePlanAction should not be nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
at __randomizedtesting.SeedInfo.seed([EBBA7F4A24CDA47F:D1149A931AA97D11]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections(ComputePlanActionTest.java:469)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12471 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/init-core-data-001
[junit4] 2> 613902 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 613903 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 613904 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 613904 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/tempDir-001
[junit4] 2> 613904 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 613905 INFO (Thread-917) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 613905 INFO (Thread-917) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 613906 ERROR (Thread-917) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 614005 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:44701
[junit4] 2> 614007 INFO (zkConnectionManagerCallback-994-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 614011 INFO (jetty-launcher-991-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T10:27:37-11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 614014 INFO (jetty-launcher-991-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 614014 INFO (jetty-launcher-991-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 614014 INFO (jetty-launcher-991-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 614014 INFO (jetty-launcher-991-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@176d55f{/solr,null,AVAILABLE}
[junit4] 2> 614017 INFO (jetty-launcher-991-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@9ba1c9{SSL,[ssl, http/1.1]}{127.0.0.1:34915}
[junit4] 2> 614017 INFO (jetty-launcher-991-thread-1) [ ] o.e.j.s.Server Started @615336ms
[junit4] 2> 614017 INFO (jetty-launcher-991-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34915}
[junit4] 2> 614018 ERROR (jetty-launcher-991-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 614018 INFO (jetty-launcher-991-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 614018 INFO (jetty-launcher-991-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 614018 INFO (jetty-launcher-991-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 614018 INFO (jetty-launcher-991-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T11:58:16.509Z
[junit4] 2> 614022 INFO (zkConnectionManagerCallback-996-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 614023 INFO (jetty-launcher-991-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 614032 INFO (jetty-launcher-991-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44701/solr
[junit4] 2> 614033 INFO (zkConnectionManagerCallback-1000-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 614035 INFO (zkConnectionManagerCallback-1002-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 614126 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 614126 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34915_solr
[junit4] 2> 614127 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer Overseer (id=72124903234600963-127.0.0.1:34915_solr-n_0000000000) starting
[junit4] 2> 614131 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 614132 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34915_solr
[junit4] 2> 614132 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 614132 INFO (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 614133 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 614133 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:34915_solr]
[junit4] 2> 614133 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 614133 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 614139 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 614139 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 614140 DEBUG (ScheduledTrigger-1682-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 614328 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34915.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 614337 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34915.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 614337 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34915.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 614339 INFO (jetty-launcher-991-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/tempDir-001/node1/.
[junit4] 2> 614356 INFO (zkConnectionManagerCallback-1006-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 614360 INFO (zkConnectionManagerCallback-1010-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 614361 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 614362 INFO (SUITE-ComputePlanActionTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44701/solr ready
[junit4] 2> 614372 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAdded
[junit4] 2> 614372 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 614372 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 614373 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 614373 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 614374 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 614374 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 614449 INFO (qtp14049233-4203) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 614450 DEBUG (qtp14049233-4207) [n:127.0.0.1:34915_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 614450 INFO (qtp14049233-4207) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=9
[junit4] 2> 614450 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 614450 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 614451 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 614451 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 614451 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 614456 INFO (qtp14049233-4208) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 614457 DEBUG (qtp14049233-4209) [n:127.0.0.1:34915_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 614458 INFO (qtp14049233-4209) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 614458 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 614458 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 614458 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 614460 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 614460 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 614463 INFO (qtp14049233-4203) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 614463 DEBUG (qtp14049233-4207) [n:127.0.0.1:34915_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 614464 INFO (qtp14049233-4207) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 614464 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 614467 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:34915_solr]
[junit4] 2> 614467 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, class=solr.ComputePlanAction}, {name=test, class=org.apache.solr.cloud.autoscaling.ComputePlanActionTest$AssertingTriggerAction}], enabled=true}
[junit4] 2> 614467 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 614468 INFO (qtp14049233-4208) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 614468 DEBUG (qtp14049233-4209) [n:127.0.0.1:34915_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 614469 INFO (qtp14049233-4209) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 614469 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 614469 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 614470 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:34915_solr]
[junit4] 2> 614470 DEBUG (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, class=solr.ComputePlanAction}, {name=test, class=org.apache.solr.cloud.autoscaling.ComputePlanActionTest$AssertingTriggerAction}], enabled=true}
[junit4] 2> 614470 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 5
[junit4] 2> 614470 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 614470 DEBUG (ScheduledTrigger-1682-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 614470 DEBUG (ScheduledTrigger-1682-thread-1) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 614470 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 614470 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 614471 INFO (qtp14049233-4207) [n:127.0.0.1:34915_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=testNodeAdded&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 614476 INFO (OverseerThreadFactory-1684-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testNodeAdded
[junit4] 2> 614476 WARN (OverseerThreadFactory-1684-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 2 on collection testNodeAdded is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 614478 INFO (qtp14049233-4203) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 614479 INFO (OverseerThreadFactory-1684-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 1027057407 sessionWrapper.createTime 1027057407546156, this.sessionWrapper.createTime 1027057407546156
[junit4] 2> 614481 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"testNodeAdded",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 614482 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeAdded
[junit4] 2> 614482 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/testNodeAdded/state.json
[junit4] 2> 614584 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 614584 INFO (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 614585 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 614585 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 614586 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 614586 INFO (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 614587 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 614587 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 614687 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 0
[junit4] 2> 614793 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 614793 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 614794 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 614796 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 614796 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 614797 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeAdded_shard1_replica_n2","base_url":"https://127.0.0.1:34915/solr","node_name":"127.0.0.1:34915_solr","state":"down","type":"NRT"}
[junit4] 2> 614797 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 614797 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 614797 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 614797 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeAdded_shard1_replica_n1","base_url":"https://127.0.0.1:34915/solr","node_name":"127.0.0.1:34915_solr","state":"down","type":"NRT"}
[junit4] 2> 614797 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 614898 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 1
[junit4] 2> 614898 INFO (zkCallback-1001-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 614898 INFO (zkCallback-1001-thread-2-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 615472 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 615472 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 615805 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 615806 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 615812 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.IndexSchema [testNodeAdded_shard1_replica_n2] Schema name=minimal
[junit4] 2> 615813 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.IndexSchema [testNodeAdded_shard1_replica_n1] Schema name=minimal
[junit4] 2> 615816 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 615816 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testNodeAdded_shard1_replica_n2' using configuration from collection testNodeAdded, trusted=true
[junit4] 2> 615816 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 615816 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testNodeAdded_shard1_replica_n1' using configuration from collection testNodeAdded, trusted=true
[junit4] 2> 615818 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34915.solr.core.testNodeAdded.shard1.replica_n2' (registry 'solr.core.testNodeAdded.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 615818 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34915.solr.core.testNodeAdded.shard1.replica_n1' (registry 'solr.core.testNodeAdded.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 615818 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 615818 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 615818 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrCore [[testNodeAdded_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/tempDir-001/node1/testNodeAdded_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/tempDir-001/node1/./testNodeAdded_shard1_replica_n2/data/]
[junit4] 2> 615818 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrCore [[testNodeAdded_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/tempDir-001/node1/testNodeAdded_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/tempDir-001/node1/./testNodeAdded_shard1_replica_n1/data/]
[junit4] 2> 615899 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 615899 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 615899 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 615899 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 615901 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 615901 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 615901 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 615902 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 615904 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@89cf88[testNodeAdded_shard1_replica_n2] main]
[junit4] 2> 615904 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e9619c[testNodeAdded_shard1_replica_n1] main]
[junit4] 2> 615905 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 615905 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 615906 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 615906 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 615907 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 615907 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 615908 INFO (searcherExecutor-1687-thread-1-processing-n:127.0.0.1:34915_solr x:testNodeAdded_shard1_replica_n2 s:shard1 c:testNodeAdded r:core_node4) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrCore [testNodeAdded_shard1_replica_n2] Registered new searcher Searcher@89cf88[testNodeAdded_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 615908 INFO (searcherExecutor-1688-thread-1-processing-n:127.0.0.1:34915_solr x:testNodeAdded_shard1_replica_n1 s:shard1 c:testNodeAdded r:core_node3) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrCore [testNodeAdded_shard1_replica_n1] Registered new searcher Searcher@1e9619c[testNodeAdded_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 615908 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592015085527629824
[junit4] 2> 615909 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592015085528678400
[junit4] 2> 615913 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ZkShardTerms Failed to save terms, version is not match, retrying
[junit4] 2> 615916 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 615916 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 615916 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34915/solr/testNodeAdded_shard1_replica_n1/
[junit4] 2> 615916 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded"} current state version: 0
[junit4] 2> 615916 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testNodeAdded_shard1_replica_n1 url=https://127.0.0.1:34915/solr START replicas=[https://127.0.0.1:34915/solr/testNodeAdded_shard1_replica_n2/] nUpdates=100
[junit4] 2> 615921 INFO (qtp14049233-4209) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.S.Request [testNodeAdded_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 616017 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 2
[junit4] 2> 616017 INFO (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 616017 INFO (zkCallback-1001-thread-2-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 616217 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testNodeAdded_shard1_replica_n1 url=https://127.0.0.1:34915/solr DONE. We have no versions. sync failed.
[junit4] 2> 616217 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 616217 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 616217 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 616219 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34915/solr/testNodeAdded_shard1_replica_n1/ shard1
[junit4] 2> 616220 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 616320 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 3
[junit4] 2> 616321 INFO (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 616321 INFO (zkCallback-1001-thread-2-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 616370 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 616372 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 616372 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 616372 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeAdded_shard1_replica_n1","base_url":"https://127.0.0.1:34915/solr","node_name":"127.0.0.1:34915_solr","state":"active","type":"NRT","leader":"true"}
[junit4] 2> 616372 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 616447 INFO (qtp14049233-4239) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1654
[junit4] 2> 616472 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 616472 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 616473 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 4
[junit4] 2> 616473 INFO (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 616473 INFO (zkCallback-1001-thread-2-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 616917 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 616917 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 616917 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeAdded_shard1_replica_n2","base_url":"https://127.0.0.1:34915/solr","node_name":"127.0.0.1:34915_solr","state":"active","type":"NRT"}
[junit4] 2> 616917 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/5)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 616958 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2165
[junit4] 2> 616962 INFO (qtp14049233-4207) [n:127.0.0.1:34915_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 617018 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 5
[junit4] 2> 617018 INFO (zkCallback-1001-thread-2-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 617018 INFO (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 617472 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 617473 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 617962 INFO (qtp14049233-4207) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=testNodeAdded&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3491
[junit4] 2> 617968 INFO (qtp14049233-4208) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testNodeAdded.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testNodeAdded.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 617972 INFO (qtp14049233-4240) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 617973 DEBUG (qtp14049233-4202) [n:127.0.0.1:34915_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 617974 INFO (qtp14049233-4202) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 617974 DEBUG (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 617975 DEBUG (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:34915_solr]
[junit4] 2> 617975 DEBUG (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, class=solr.ComputePlanAction}, {name=test, class=org.apache.solr.cloud.autoscaling.ComputePlanActionTest$AssertingTriggerAction}], enabled=true}
[junit4] 2> 617975 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 617975 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 617976 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 617977 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T10:27:37-11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 617977 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 617977 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 617977 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 617978 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@682fd3{/solr,null,AVAILABLE}
[junit4] 2> 617978 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1b352fc{SSL,[ssl, http/1.1]}{127.0.0.1:39019}
[junit4] 2> 617978 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j.s.Server Started @619297ms
[junit4] 2> 617978 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39019}
[junit4] 2> 617979 ERROR (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 617979 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 617979 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 617979 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 617979 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T11:58:20.470Z
[junit4] 2> 617981 INFO (zkConnectionManagerCallback-1013-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 617982 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 617992 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44701/solr
[junit4] 2> 617994 INFO (zkConnectionManagerCallback-1017-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 617996 INFO (zkConnectionManagerCallback-1019-thread-1-processing-n:127.0.0.1:39019_solr) [n:127.0.0.1:39019_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 618001 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [n:127.0.0.1:39019_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 618002 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [n:127.0.0.1:39019_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 618004 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [n:127.0.0.1:39019_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39019_solr
[junit4] 2> 618005 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:39019_solr"} current state version: 0
[junit4] 2> 618005 DEBUG (OverseerStateUpdate-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:39019_solr
[junit4] 2> 618005 INFO (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 618005 INFO (zkCallback-1009-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 618005 INFO (zkCallback-1009-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 618006 INFO (zkCallback-1018-thread-1-processing-n:127.0.0.1:39019_solr) [n:127.0.0.1:39019_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 618177 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [n:127.0.0.1:39019_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39019.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 618188 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [n:127.0.0.1:39019_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39019.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 618189 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [n:127.0.0.1:39019_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39019.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@12fe9f8
[junit4] 2> 618190 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [n:127.0.0.1:39019_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_EBBA7F4A24CDA47F-001/tempDir-001/node2/.
[junit4] 2> 618473 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 618473 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 618473 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:39019_solr at time 1027061401840877
[junit4] 2> 618478 INFO (OverseerCollectionConfigSetProcessor-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 619474 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 619474 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 619474 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:39019_solr] added at times [1027061401840877], now=1027062403035688
[junit4] 2> 619474 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"3a61b5e04ecedT78agd439mwxs7djifq7sqiodg",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":1027061401840877,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1027061401840877],
[junit4] 2> "nodeNames":["127.0.0.1:39019_solr"]}}
[junit4] 2> 619475 DEBUG (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_trigger]
[junit4] 2> 619476 INFO (ScheduledTrigger-1682-thread-2) [n:127.0.0.1:34915_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 619476 DEBUG (AutoscalingActionExecutor-1683-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"3a61b5e04ecedT78agd439mwxs7djifq7sqiodg",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":1027061401840877,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1027061401840877],
[junit4] 2> "_enqueue_time_":1027062403753183,
[junit4] 2> "nodeNames":["127.0.0.1:39019_solr"]}}
[junit4] 2> 619476 DEBUG (AutoscalingActionExecutor-1683-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"3a61b5e04ecedT78agd439mwxs7djifq7sqiodg",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":1027061401840877,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1027061401840877],
[junit4] 2> "_enqueue_time_":1027062403753183,
[junit4] 2> "nodeNames":["127.0.0.1:39019_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 619479 INFO (qtp14049233-4208) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testNodeAdded.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testNodeAdded.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 619482 INFO (qtp14049233-4202) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 619564 INFO (qtp22235156-4265) [n:127.0.0.1:39019_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 619565 INFO (AutoscalingActionExecutor-1683-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testNodeAdded&targetNode=127.0.0.1:39019_solr&inPlaceMove=true&replica=core_node3
[junit4] 2> 619566 INFO (AutoscalingActionExecutor-1683-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 1027062494 sessionWrapper.createTime 1027062493489752, this.sessionWrapper.createTime 1027062493489752
[junit4] 2> 619566 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.a.ComputePlanActionTest -------------_ FINAL STATE --------------
[junit4] 2> 619567 DEBUG (AutoscalingActionExecutor-1683-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 5000ms
[junit4] 2> 619567 DEBUG (AutoscalingActionExecutor-1683-thread-1-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 90 ms for event id=3a61b5e04ecedT78agd439mwxs7djifq7sqiodg
[junit4] 2> 619569 INFO (qtp14049233-4208) [n:127.0.0.1:34915_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 619570 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.a.ComputePlanActionTest * Node values: 127.0.0.1:34915_solr
[junit4] 2> {
[junit4] 2> "node":"127.0.0.1:34915_solr",
[junit4] 2> "cores":2,
[junit4] 2> "port":"34915",
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "ip_1":"1",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"127",
[junit4] 2> "freedisk":211.65549850463867}
[junit4] 2> 619572 INFO (qtp22235156-4267) [n:127.0.0.1:39019_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 619573 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.a.ComputePlanActionTest * Node values: 127.0.0.1:39019_solr
[junit4] 2> {
[junit4] 2> "node":"127.0.0.1:39019_solr",
[junit4] 2> "cores":0,
[junit4] 2> "port":"39019",
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "ip_1":"1",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"127",
[junit4] 2> "freedisk":211.65549850463867}
[junit4] 2> 619573 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.a.ComputePlanActionTest * Live nodes: [127.0.0.1:34915_solr, 127.0.0.1:39019_solr]
[junit4] 2> 619574 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.c.a.ComputePlanActionTest * Collection testNodeAdded state: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/6)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:34915/solr",
[junit4] 2> "node_name":"127.0.0.1:34915_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"}}}},
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0"}
[junit4] 2> 619574 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAdded
[junit4] 2> 619591 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[EBBA7F4A24CDA47F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLost
[junit4] 2> 619592 DEBUG (zkCallback-1001-thread-3-processing-n:127.0.0.1:34915_solr) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 619592 DEBUG (OverseerAutoScalingTriggerThread-72124903234600963-127.0.0.1:34915_solr-n_0000000000) [n:127.0.0.1:34915_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 619593 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[EBBA7F4A24CDA47F]) [ ] o.e.j
[...truncated too long message...]
2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 38 /solr/collections/rulesColl/state.json
[junit4] 2> 16 /solr/collections/modifyColl/state.json
[junit4] 2> 13 /solr/clusterstate.json
[junit4] 2> 12 /solr/collections/hostFragment/state.json
[junit4] 2> 6 /solr/collections/portRuleColl2/state.json
[junit4] 2> 6 /solr/collections/portRuleColl/state.json
[junit4] 2> 2 /solr/overseer_elect/election/72124988495953930-127.0.0.1:36003_solr-n_0000000002
[junit4] 2> 2 /solr/overseer_elect/election/72124988495953933-127.0.0.1:37007_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 46 /solr/collections
[junit4] 2> 13 /solr/live_nodes
[junit4] 2>
[junit4] 2> 1976592 INFO (SUITE-RulesTest-seed#[EBBA7F4A24CDA47F]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 10, 2018 12:20:59 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Feb 10, 2018 12:21:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.rule.RulesTest:
[junit4] 2> 1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Feb 10, 2018 12:21:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest]
[junit4] 2> Feb 10, 2018 12:21:22 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1770, maxMBSortInHeap=6.82594563519436, sim=RandomSimilarity(queryNorm=false): {}, locale=th, timezone=CTT
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=2,free=281410632,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [SuggesterTest, TestSchemaVersionResource, QueryParsingTest, TestRebalanceLeaders, FastVectorHighlighterTest, AlternateDirectoryTest, TestUninvertingReader, DeleteNodeTest, TestReplicationHandler, TestQueryUtils, DocValuesNotIndexedTest, UninvertDocValuesMergePolicyTest, ZkStateWriterTest, MoveReplicaHDFSFailoverTest, TestPerFieldSimilarity, TestCorePropertiesReload, TestSearchPerf, TestImpersonationWithHadoopAuth, SyncSliceTest, DeleteStatusTest, CdcrVersionReplicationTest, DistributedDebugComponentTest, MetricTriggerTest, TermsComponentTest, TestReversedWildcardFilterFactory, SolrCoreTest, DistributedMLTComponentTest, TestEmbeddedSolrServerAdminHandler, TestSurroundQueryParser, TestPullReplicaErrorHandling, TestHashQParserPlugin, TestPolicyCloud, SchemaVersionSpecificBehaviorTest, JvmMetricsTest, PropertiesRequestHandlerTest, HdfsRestartWhileUpdatingTest, SolrShardReporterTest, OverseerTest, QueryEqualityTest, TestTrie, TestUseDocValuesAsStored, SpellCheckCollatorWithCollapseTest, UpdateLogTest, TestConfigSetImmutable, HttpSolrCallGetCoreTest, TestJettySolrRunner, CdcrUpdateLogTest, PolyFieldTest, TestCharFilters, TestExclusionRuleCollectionAccess, DirectSolrConnectionTest, TestDeleteCollectionOnDownNodes, OverseerRolesTest, HighlighterMaxOffsetTest, BaseCdcrDistributedZkTest, TestMacroExpander, SolrInfoBeanTest, TestDistribIDF, BlockJoinFacetSimpleTest, TestOnReconnectListenerSupport, AsyncCallRequestStatusResponseTest, ClassificationUpdateProcessorIntegrationTest, TestCollectionsAPIViaSolrCloudCluster, TestManagedStopFilterFactory, TestFunctionQuery, SolrIndexMetricsTest, StressHdfsTest, TestSimpleTextCodec, IndexSchemaTest, QueryElevationComponentTest, FileUtilsTest, LoggingHandlerTest, FieldMutatingUpdateProcessorTest, TestRecovery, DirectoryFactoryTest, TestSystemCollAutoCreate, TestFuzzyAnalyzedSuggestions, StatsReloadRaceTest, TestDynamicFieldCollectionResource, DistributedIntervalFacetingTest, ConcurrentDeleteAndCreateCollectionTest, TestNumericRangeQuery64, TestTrieFacet, UUIDUpdateProcessorFallbackTest, ShardRoutingCustomTest, LeaderFailoverAfterPartitionTest, JsonLoaderTest, TestMinMaxOnMultiValuedField, TestConfigsApi, TestJsonRequest, ShardSplitTest, TestSubQueryTransformerDistrib, TestNoOpRegenerator, TestFieldSortValues, ZkControllerTest, TestBM25SimilarityFactory, SearchHandlerTest, TestSolrIndexConfig, TestCollationFieldDocValues, TestSmileRequest, BitVectorTest, SOLR749Test, TestCloudSearcherWarming, TestClassicSimilarityFactory, TestReqParamsAPI, TestSolrCLIRunExample, TestRTGBase, ReplaceNodeNoTargetTest, HLLSerializationTest, TestReloadDeadlock, TestTolerantUpdateProcessorRandomCloud, PKIAuthenticationIntegrationTest, HdfsDirectoryTest, TestFastLRUCache, TestRuleBasedAuthorizationPlugin, TestReload, SolrMetricManagerTest, TestNestedDocsSort, TestSolrJ, TestZkChroot, TestPayloadScoreQParserPlugin, TestLegacyFieldCache, SliceStateTest, CollectionStateFormat2Test, RulesTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RulesTest -Dtests.seed=EBBA7F4A24CDA47F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=CTT -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | RulesTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.rule.RulesTest:
[junit4] > 1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([EBBA7F4A24CDA47F]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=16595, name=qtp27345429-16595, state=TIMED_WAITING, group=TGRP-RulesTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([EBBA7F4A24CDA47F]:0)
[junit4] Completed [392/774 (3!)] on J1 in 84.84s, 7 tests, 2 errors <<< FAILURES!
[...truncated 45166 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1328
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1328/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseSerialGC
3 tests failed.
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitWithChaosMonkey
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([6E199299B77EFC76:E53E4148F67857F2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:915)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitWithChaosMonkey(ShardSplitTest.java:431)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:45423/solr]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:45423/solr]
at __randomizedtesting.SeedInfo.seed([6E199299B77EFC76:56AAB667908D28A7]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple(AutoAddReplicasPlanActionTest.java:110)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:45423/solr
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
... 44 more
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:45423 failed to respond
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 48 more
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([6E199299B77EFC76:83D905890A1261AF]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners(TriggerIntegrationTest.java:1053)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12416 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest
[junit4] 2> 371488 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/init-core-data-001
[junit4] 2> 371488 WARN (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
[junit4] 2> 371489 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 371490 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 371492 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001
[junit4] 2> 371492 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 371493 INFO (Thread-550) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 371493 INFO (Thread-550) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 371495 ERROR (Thread-550) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 371593 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:38537
[junit4] 2> 371600 INFO (zkConnectionManagerCallback-851-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371610 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 371610 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 371611 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 371612 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 371616 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@df5ff5{/solr,null,AVAILABLE}
[junit4] 2> 371616 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3dee49{/solr,null,AVAILABLE}
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@241d5a{SSL,[ssl, http/1.1]}{127.0.0.1:38563}
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@17ff56a{SSL,[ssl, http/1.1]}{127.0.0.1:38849}
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.Server Started @372777ms
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.Server Started @372778ms
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38563}
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38849}
[junit4] 2> 371624 ERROR (jetty-launcher-848-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 371624 ERROR (jetty-launcher-848-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4276a8{/solr,null,AVAILABLE}
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T07:36:32.410Z
[junit4] 2> 371624 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T07:36:32.410Z
[junit4] 2> 371625 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@10dbc5b{SSL,[ssl, http/1.1]}{127.0.0.1:45423}
[junit4] 2> 371625 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.Server Started @372779ms
[junit4] 2> 371625 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45423}
[junit4] 2> 371625 ERROR (jetty-launcher-848-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 371626 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 371626 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 371626 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 371626 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-10T07:36:32.412Z
[junit4] 2> 371627 INFO (zkConnectionManagerCallback-854-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371628 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 371632 INFO (zkConnectionManagerCallback-855-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371633 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 371636 INFO (zkConnectionManagerCallback-857-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371637 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 371642 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38537/solr
[junit4] 2> 371643 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38537/solr
[junit4] 2> 371644 INFO (zkConnectionManagerCallback-862-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371645 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1003c48048d0004, likely client has closed socket
[junit4] 2> 371645 INFO (zkConnectionManagerCallback-865-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371648 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38537/solr
[junit4] 2> 371655 INFO (zkConnectionManagerCallback-868-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371655 INFO (zkConnectionManagerCallback-870-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371656 INFO (zkConnectionManagerCallback-873-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371662 INFO (zkConnectionManagerCallback-875-thread-1-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 371759 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 371759 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:45423_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 371759 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:38849_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 371760 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38563_solr
[junit4] 2> 371760 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:45423_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45423_solr
[junit4] 2> 371760 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:38849_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38849_solr
[junit4] 2> 371760 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.c.Overseer Overseer (id=72123874049589254-127.0.0.1:38563_solr-n_0000000000) starting
[junit4] 2> 371765 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 371766 INFO (zkCallback-874-thread-1-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 371766 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 371791 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38563_solr
[junit4] 2> 371792 INFO (zkCallback-874-thread-1-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 371792 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 371804 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 371901 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:45423_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45423.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 371916 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:45423_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45423.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 371916 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:45423_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45423.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 371918 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:45423_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node2/.
[junit4] 2> 372037 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:38849_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38849.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 372053 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:38849_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38849.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 372054 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:38849_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38849.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 372055 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:38849_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node1/.
[junit4] 2> 372195 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38563.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 372211 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38563.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 372212 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38563.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 372213 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:38563_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node3/.
[junit4] 2> 372262 INFO (zkConnectionManagerCallback-883-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 372279 INFO (zkConnectionManagerCallback-887-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 372280 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 372281 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6E199299B77EFC76]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38537/solr ready
[junit4] 2> 372298 INFO (TEST-AutoAddReplicasPlanActionTest.testSimple-seed#[6E199299B77EFC76]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
[junit4] 2> 372400 INFO (qtp7606036-3294) [n:127.0.0.1:38849_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:45423_solr,127.0.0.1:38849_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 372402 INFO (OverseerThreadFactory-1174-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testSimple1
[junit4] 2> 372508 INFO (OverseerStateUpdate-72123874049589254-127.0.0.1:38563_solr-n_0000000000) [n:127.0.0.1:38563_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38849/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 372509 INFO (OverseerStateUpdate-72123874049589254-127.0.0.1:38563_solr-n_0000000000) [n:127.0.0.1:38563_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45423/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 372511 INFO (OverseerStateUpdate-72123874049589254-127.0.0.1:38563_solr-n_0000000000) [n:127.0.0.1:38563_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38849/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 372513 INFO (OverseerStateUpdate-72123874049589254-127.0.0.1:38563_solr-n_0000000000) [n:127.0.0.1:38563_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45423/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 372728 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 372729 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 372729 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 372795 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 372795 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 372817 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 372920 INFO (zkCallback-874-thread-1-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 372920 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 372920 INFO (zkCallback-874-thread-2-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 373740 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 373744 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 373754 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
[junit4] 2> 373757 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 373758 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 373758 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
[junit4] 2> 373758 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38849.solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 373758 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 373759 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node1/testSimple1_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node1/./testSimple1_shard2_replica_n4/data/]
[junit4] 2> 373759 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 373759 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
[junit4] 2> 373759 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38849.solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 373760 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 373760 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node1/testSimple1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node1/./testSimple1_shard1_replica_n1/data/]
[junit4] 2> 373805 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 373822 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
[junit4] 2> 373825 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 373825 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 373825 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 373825 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 373825 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
[junit4] 2> 373826 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45423.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 373826 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 373826 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node2/testSimple1_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node2/./testSimple1_shard1_replica_n2/data/]
[junit4] 2> 373827 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 373827 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 373828 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d115e4[testSimple1_shard2_replica_n4] main]
[junit4] 2> 373829 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 373829 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 373830 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 373831 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 373831 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 373831 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
[junit4] 2> 373842 INFO (searcherExecutor-1181-thread-1-processing-n:127.0.0.1:38849_solr x:testSimple1_shard2_replica_n4 s:shard2 c:testSimple1 r:core_node7) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [testSimple1_shard2_replica_n4] Registered new searcher Searcher@1d115e4[testSimple1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 373842 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591998618930249728
[junit4] 2> 373842 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 373842 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 373843 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 373843 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
[junit4] 2> 373843 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45423.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 373843 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 373843 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node2/testSimple1_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node2/./testSimple1_shard2_replica_n6/data/]
[junit4] 2> 373845 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@481f7e[testSimple1_shard1_replica_n1] main]
[junit4] 2> 373845 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 373846 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 373847 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 373847 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591998618935492608
[junit4] 2> 373848 INFO (searcherExecutor-1182-thread-1-processing-n:127.0.0.1:38849_solr x:testSimple1_shard1_replica_n1 s:shard1 c:testSimple1 r:core_node3) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [testSimple1_shard1_replica_n1] Registered new searcher Searcher@481f7e[testSimple1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 373851 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 373854 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 373895 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 373895 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 373897 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 373897 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 373898 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@11e53e[testSimple1_shard1_replica_n2] main]
[junit4] 2> 373899 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 373899 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 373899 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 373899 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 373900 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 373900 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 373900 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 373900 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591998618991067136
[junit4] 2> 373902 INFO (searcherExecutor-1186-thread-1-processing-n:127.0.0.1:45423_solr x:testSimple1_shard1_replica_n2 s:shard1 c:testSimple1 r:core_node5) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [testSimple1_shard1_replica_n2] Registered new searcher Searcher@11e53e[testSimple1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 373902 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@16c8b33[testSimple1_shard2_replica_n6] main]
[junit4] 2> 373903 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 373903 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 373904 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 373905 INFO (searcherExecutor-1192-thread-1-processing-n:127.0.0.1:45423_solr x:testSimple1_shard2_replica_n6 s:shard2 c:testSimple1 r:core_node8) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [testSimple1_shard2_replica_n6] Registered new searcher Searcher@16c8b33[testSimple1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 373905 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591998618996310016
[junit4] 2> 373955 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 373955 INFO (zkCallback-874-thread-2-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 373955 INFO (zkCallback-874-thread-1-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374352 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 374352 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 374352 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38849/solr/testSimple1_shard2_replica_n4/
[junit4] 2> 374352 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n4 url=https://127.0.0.1:38849/solr START replicas=[https://127.0.0.1:45423/solr/testSimple1_shard2_replica_n6/] nUpdates=100
[junit4] 2> 374355 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 374355 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 374355 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38849/solr/testSimple1_shard1_replica_n1/
[junit4] 2> 374355 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=https://127.0.0.1:38849/solr START replicas=[https://127.0.0.1:45423/solr/testSimple1_shard1_replica_n2/] nUpdates=100
[junit4] 2> 374359 INFO (qtp8878720-3281) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.S.Request [testSimple1_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 374362 INFO (qtp8878720-3287) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.S.Request [testSimple1_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 374653 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n4 url=https://127.0.0.1:38849/solr DONE. We have no versions. sync failed.
[junit4] 2> 374653 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 374653 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 374653 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 374655 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=https://127.0.0.1:38849/solr DONE. We have no versions. sync failed.
[junit4] 2> 374656 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 374656 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 374656 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 374656 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38849/solr/testSimple1_shard2_replica_n4/ shard2
[junit4] 2> 374658 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38849/solr/testSimple1_shard1_replica_n1/ shard1
[junit4] 2> 374760 INFO (zkCallback-874-thread-1-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374760 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374760 INFO (zkCallback-874-thread-2-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374806 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 374808 INFO (qtp7606036-3286) [n:127.0.0.1:38849_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2080
[junit4] 2> 374809 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 374810 INFO (qtp7606036-3288) [n:127.0.0.1:38849_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2081
[junit4] 2> 374907 INFO (qtp8878720-3371) [n:127.0.0.1:45423_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2112
[junit4] 2> 374917 INFO (qtp8878720-3301) [n:127.0.0.1:45423_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2099
[junit4] 2> 374921 INFO (qtp7606036-3294) [n:127.0.0.1:38849_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 375013 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 375013 INFO (zkCallback-874-thread-2-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 375013 INFO (zkCallback-874-thread-1-processing-n:127.0.0.1:45423_solr) [n:127.0.0.1:45423_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 375921 INFO (qtp7606036-3294) [n:127.0.0.1:38849_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:45423_solr,127.0.0.1:38849_solr&wt=javabin&version=2} status=0 QTime=3520
[junit4] 2> 375923 INFO (qtp7606036-3299) [n:127.0.0.1:38849_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:38849_solr,127.0.0.1:38563_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 375925 INFO (OverseerThreadFactory-1174-thread-2-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testSimple2
[junit4] 2> 375925 INFO (OverseerCollectionConfigSetProcessor-72123874049589254-127.0.0.1:38563_solr-n_0000000000) [n:127.0.0.1:38563_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 376131 INFO (OverseerStateUpdate-72123874049589254-127.0.0.1:38563_solr-n_0000000000) [n:127.0.0.1:38563_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38849/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 376133 INFO (OverseerStateUpdate-72123874049589254-127.0.0.1:38563_solr-n_0000000000) [n:127.0.0.1:38563_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38563/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 376336 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 376425 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 376426 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 376529 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 376529 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 376529 INFO (zkCallback-869-thread-2-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 376530 INFO (zkCallback-867-thread-2-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 377346 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 377368 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n1] Schema name=minimal
[junit4] 2> 377370 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 377370 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n1' using configuration from collection testSimple2, trusted=true
[junit4] 2> 377370 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38849.solr.core.testSimple2.shard1.replica_n1' (registry 'solr.core.testSimple2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 377370 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 377371 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node1/testSimple2_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node1/./testSimple2_shard1_replica_n1/data/]
[junit4] 2> 377417 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 377417 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 377418 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 377418 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 377420 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1defeeb[testSimple2_shard1_replica_n1] main]
[junit4] 2> 377421 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 377421 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 377422 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 377423 INFO (searcherExecutor-1201-thread-1-processing-n:127.0.0.1:38849_solr x:testSimple2_shard1_replica_n1 s:shard1 c:testSimple2 r:core_node3) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [testSimple2_shard1_replica_n1] Registered new searcher Searcher@1defeeb[testSimple2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 377423 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591998622685200384
[junit4] 2> 377428 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 377447 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 377453 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n2] Schema name=minimal
[junit4] 2> 377455 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 377455 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n2' using configuration from collection testSimple2, trusted=true
[junit4] 2> 377456 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38563.solr.core.testSimple2.shard1.replica_n2' (registry 'solr.core.testSimple2.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de83c6
[junit4] 2> 377456 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 377456 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node3/testSimple2_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6E199299B77EFC76-001/tempDir-001/node3/./testSimple2_shard1_replica_n2/data/]
[junit4] 2> 377502 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 377502 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 377503 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 377503 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 377505 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@af774[testSimple2_shard1_replica_n2] main]
[junit4] 2> 377506 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 377507 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 377507 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 377507 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591998622773280768
[junit4] 2> 377508 INFO (searcherExecutor-1206-thread-1-processing-n:127.0.0.1:38563_solr x:testSimple2_shard1_replica_n2 s:shard1 c:testSimple2 r:core_node4) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [testSimple2_shard1_replica_n2] Registered new searcher Searcher@af774[testSimple2_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 377529 INFO (zkCallback-869-thread-2-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 377529 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 377529 INFO (zkCallback-867-thread-2-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 377529 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 377928 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 377929 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 377929 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38849/solr/testSimple2_shard1_replica_n1/
[junit4] 2> 377929 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard1_replica_n1 url=https://127.0.0.1:38849/solr START replicas=[https://127.0.0.1:38563/solr/testSimple2_shard1_replica_n2/] nUpdates=100
[junit4] 2> 377935 INFO (qtp16495928-3282) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.S.Request [testSimple2_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 378229 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard1_replica_n1 url=https://127.0.0.1:38849/solr DONE. We have no versions. sync failed.
[junit4] 2> 378229 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 378229 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 378229 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 378233 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38849/solr/testSimple2_shard1_replica_n1/ shard1
[junit4] 2> 378335 INFO (zkCallback-867-thread-2-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378335 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378335 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378335 INFO (zkCallback-869-thread-2-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378384 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 378487 INFO (zkCallback-869-thread-2-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378487 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378487 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:38849_solr) [n:127.0.0.1:38849_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378487 INFO (zkCallback-867-thread-2-processing-n:127.0.0.1:38563_solr) [n:127.0.0.1:38563_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378523 INFO (qtp7606036-3296) [n:127.0.0.1:38849_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2187
[junit4] 2> 378527 INFO (qtp16495928-3295) [n:127.0.0.1:38563_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2102
[junit4] 2> 378530 INFO (qtp7606036-3299) [n:127.0.0.1:38849_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[j
[...truncated too long message...]
bb
[junit4] 2> 3533079 INFO (coreCloseExecutor-10067-thread-1) [n:127.0.0.1:37129_ c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n47, tag=21812155
[junit4] 2> 3533079 INFO (coreCloseExecutor-10067-thread-1) [n:127.0.0.1:37129_ c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c2da50: rootName = null, domain = solr.core.collection1.shard1.replica_n47, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n47 / com.codahale.metrics.MetricRegistry@148d488
[junit4] 2> 3533093 INFO (coreCloseExecutor-10067-thread-1) [n:127.0.0.1:37129_ c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=21812155
[junit4] 2> 3533095 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6E199299B77EFC76]) [ ] o.a.s.c.Overseer Overseer (id=72124078864400402-127.0.0.1:37129_-n_0000000004) closing
[junit4] 2> 3533095 INFO (OverseerStateUpdate-72124078864400402-127.0.0.1:37129_-n_0000000004) [n:127.0.0.1:37129_ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37129_
[junit4] 2> 3533095 WARN (OverseerAutoScalingTriggerThread-72124078864400402-127.0.0.1:37129_-n_0000000004) [n:127.0.0.1:37129_ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 3533101 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6E199299B77EFC76]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@541f38{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 3533101 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6E199299B77EFC76]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4a404b{/,null,UNAVAILABLE}
[junit4] 2> 3533101 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6E199299B77EFC76]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 3533102 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6E199299B77EFC76]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 35445
[junit4] 2> 3533102 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6E199299B77EFC76]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3533102 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6E199299B77EFC76]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40079 40079
[junit4] 2> 3542856 INFO (Thread-6360) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40079 40079
[junit4] 2> 3542857 WARN (Thread-6360) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/conf1
[junit4] 2> 6 /solr/collections/collection1/terms/shard1
[junit4] 2> 6 /solr/collections/testSplitStaticIndexReplication/terms/shard1_0
[junit4] 2> 5 /solr/collections/collection1/state.json
[junit4] 2> 5 /solr/collections/collection1/terms/shard2
[junit4] 2> 3 /solr/collections/testSplitStaticIndexReplication/terms/shard1_1
[junit4] 2> 3 /solr/collections/testSplitStaticIndexReplication/terms/shard1
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/testSplitStaticIndexReplication/state.json
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/72124078864400393-127.0.0.1:35233_-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/live_nodes
[junit4] 2> 9 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.ShardSplitTest_6E199299B77EFC76-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=de, timezone=NZ-CHAT
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=196425224,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TestMergePolicyConfig, DistributedTermsComponentTest, TestSortableTextField, ChaosMonkeyNothingIsSafeTest, RuleEngineTest, TestNodeLostTrigger, TestConfigSets, ChangedSchemaMergeTest, TestEmbeddedSolrServerSchemaAPI, TestTriggerIntegration, TestLuceneIndexBackCompat, TestDocTermOrds, CollectionsAPIDistributedZkTest, ExternalFileFieldSortTest, SimpleFacetsTest, TestRandomRequestDistribution, TestDynamicLoading, TestComponentsName, DistributedQueryElevationComponentTest, TestFieldTypeResource, ZkFailoverTest, BlockJoinFacetRandomTest, CloudExitableDirectoryReaderTest, TestCloudRecovery, TestCustomSort, SolrCoreCheckLockOnStartupTest, TestCollectionAPIs, MoveReplicaTest, JavabinLoaderTest, UtilsToolTest, FullHLLTest, OutputWriterTest, CustomHighlightComponentTest, OpenExchangeRatesOrgProviderTest, TestSchemaSimilarityResource, HdfsDirectoryFactoryTest, PreAnalyzedFieldManagedSchemaCloudTest, SuggesterWFSTTest, TestPseudoReturnFields, RAMDirectoryFactoryTest, TestCrossCoreJoin, TestLMDirichletSimilarityFactory, PluginInfoTest, SimpleMLTQParserTest, DocValuesMissingTest, TestPullReplica, TestFastOutputStream, OpenCloseCoreStressTest, DistributedVersionInfoTest, TestPHPSerializedResponseWriter, CollectionReloadTest, SolrIndexSplitterTest, TestDelegationWithHadoopAuth, TestExtendedDismaxParser, EchoParamsTest, TestCloudNestedDocsSort, ConcurrentCreateRoutedAliasTest, TestSortByMinMaxFunction, TestInitParams, TestRandomFaceting, TestLegacyNumericUtils, TestManagedSynonymGraphFilterFactory, HttpTriggerListenerTest, TestBlendedInfixSuggestions, TestConfig, TestMiniSolrCloudClusterSSL, TestRTimerTree, TestSizeLimitedDistributedMap, TestComputePlanAction, TestNumericRangeQuery32, TestConfigSetsAPI, SubstringBytesRefFilterTest, TestDocSet, TestCollectionAPI, TestDownShardTolerantSearch, TestHighlightDedupGrouping, TestSSLRandomization, TestExceedMaxTermLength, DeleteShardTest, DistributedFacetPivotSmallAdvancedTest, DeleteLastCustomShardedReplicaTest, TestDefaultStatsCache, TestSQLHandler, CoreSorterTest, SolrCloudReportersTest, TestIndexSearcher, TestSolrQueryResponse, XmlUpdateRequestHandlerTest, SolrCLIZkUtilsTest, DistributedFacetExistsSmallTest, TemplateUpdateProcessorTest, NumberUtilsTest, TestNonDefinedSimilarityFactory, CdcrBootstrapTest, TestJsonFacets, TestLegacyNumericRangeQueryBuilder, TestNumericTerms64, HdfsWriteToMultipleCollectionsTest, TestCSVResponseWriter, ConjunctionSolrSpellCheckerTest, TestExactStatsCache, TestManagedResourceStorage, HdfsChaosMonkeySafeLeaderTest, LeaderInitiatedRecoveryOnShardRestartTest, TestWriterPerf, TestStressUserVersions, TestAuthenticationFramework, SynonymTokenizerTest, JSONWriterTest, TestSolrCoreParser, SuggestComponentTest, HdfsThreadLeakTest, TestScoreJoinQPScore, ZkNodePropsTest, NodeLostTriggerTest, TestLeaderElectionZkExpiry, TestIndexingPerformance, HttpPartitionOnCommitTest, RankQueryTest, ActionThrottleTest, TestSolrQueryParser, ReplicationFactorTest, TestLocalFSCloudBackupRestore, TestManagedSchema, DistributedQueryComponentCustomSortTest, TestCryptoKeys, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, SyncSliceTest, ShardRoutingTest, ZkSolrClientTest, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestJoin, StatsComponentTest, SolrCmdDistributorTest, BadIndexSchemaTest, TestSort, DirectUpdateHandlerTest, ShowFileRequestHandlerTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, SolrRequestParserTest, DocValuesTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, TestSolrDeletionPolicy1, DebugComponentTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, TestQueryTypes, TestOmitPositions, RequestHandlersTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, TestCollationField, MBeansHandlerTest, DistributedIntervalFacetingTest, AliasIntegrationTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CleanupOldIndexTest, CreateCollectionCleanupTest, DeleteReplicaTest, DistribDocExpirationUpdateProcessorTest, ForceLeaderTest, MoveReplicaHDFSFailoverTest, OverriddenZkACLAndCredentialsProvidersTest, PeerSyncReplicationTest, RemoteQueryErrorTest, ReplaceNodeTest, SSLMigrationTest, SharedFSAutoReplicaFailoverTest, SolrCloudExampleTest, TestCloudDeleteByQuery, TestCloudJSONFacetJoinDomain, TestClusterProperties, TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, TestDeleteCollectionOnDownNodes, TestExclusionRuleCollectionAccess, TestLeaderInitiatedRecoveryThread, TestRebalanceLeaders, TestSegmentSorting, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, TestStressInPlaceUpdates, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, CollectionTooManyReplicasTest, HdfsCollectionsAPIDistributedZkTest, ShardSplitTest]
[junit4] Completed [699/774 (3!)] on J0 in 838.75s, 5 tests, 1 failure <<< FAILURES!
[...truncated 44189 lines...]
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+42) - Build #
1327 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1327/
Java: 64bit/jdk-10-ea+42 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
4 tests failed.
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([6970629FB1F02A37:903DF1308D8567BD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:282)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testSetProperties
Error Message:
Expected 8 triggers but found: [x0, x1, x2, x3, x4, x5, x6] expected:<8> but was:<7>
Stack Trace:
java.lang.AssertionError: Expected 8 triggers but found: [x0, x1, x2, x3, x4, x5, x6] expected:<8> but was:<7>
at __randomizedtesting.SeedInfo.seed([6970629FB1F02A37:214B5D602DDBFB3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testSetProperties(TriggerIntegrationTest.java:1322)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testCooldown
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([6970629FB1F02A37:58CE0F7BCF5A5FC5]:0)
at org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testCooldown(TestTriggerIntegration.java:1086)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([6970629FB1F02A37:48CC6620BB8D530]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:265)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 1768 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20180210_030832_94917907549991719658128.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180210_030832_9485723396502974505547.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20180210_030832_94913411950132018576004.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 295 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J2-20180210_031442_80014084347413176577984.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J0-20180210_031442_8005027801300109488324.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J1-20180210_031442_8007439431583683896440.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 1065 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20180210_031558_91310268986084817700566.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20180210_031558_91317769270862430277310.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20180210_031558_9131013234044501048595.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 240 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20180210_031730_2743135429765937841903.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20180210_031730_27412905667307829238982.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 5 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20180210_031730_2745254487945240205974.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 245 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20180210_031741_59616605556330366121372.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 11 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20180210_031741_59616755297873601584922.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20180210_031741_59614690356908662933903.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 162 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20180210_031805_70611143014626488588752.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20180210_031805_70610999911343233798167.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20180210_031805_70618331104505298860578.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 172 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J1-20180210_031809_67215221607197554610540.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J0-20180210_031809_6726827946197163464201.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J2-20180210_031809_6749025574372052422460.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 173 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20180210_031812_89217908489286677742540.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20180210_031812_8925036793746190813995.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20180210_031812_89213860843882426423614.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 161 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20180210_031823_6942124346609273035904.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20180210_031823_6948090642096793846850.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 162 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20180210_031831_6953763376973733855284.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20180210_031831_69516634340186765350024.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20180210_031831_6954376906496613109433.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 177 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20180210_031834_44714159026818253643447.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 174 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20180210_031844_5577129983824839472619.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 29 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20180210_031844_55710814786464852305485.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 28 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20180210_031844_5578755324941412229888.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1403 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J1-20180210_032112_7194590146871193913344.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J2-20180210_032112_7191012517196356450817.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J0-20180210_032112_7198745920841114007786.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 250 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J1-20180210_032121_9806063101345424843892.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J0-20180210_032121_9803613600426132433002.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J2-20180210_032121_9807821816133544569837.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 259 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J0-20180210_032134_2246466937834428575331.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 7 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J1-20180210_032134_22417659439966979004999.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J2-20180210_032134_22412731670094597210620.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 236 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J0-20180210_032430_8179642164901422190489.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J2-20180210_032430_8251817953945754120189.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J1-20180210_032430_817359912280703065598.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 170 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J1-20180210_032434_0284575554986063836567.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J2-20180210_032434_02816678264143602459559.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J0-20180210_032434_02815353765226624750594.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 220 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J0-20180210_032439_78213058782539652120008.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 9 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J2-20180210_032439_78215182543707745635075.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J1-20180210_032439_78217183818492500151567.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 182 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J0-20180210_032538_767615983004762853247.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J1-20180210_032538_76715734033320083892142.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J2-20180210_032538_76710580063600345272443.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 258 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J1-20180210_032551_15615991410970916609669.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J2-20180210_032551_15613033037986059117596.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J0-20180210_032551_156233290930441322406.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 166 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J0-20180210_032616_17018338955883564424180.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J2-20180210_032616_17017962031832605053619.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J1-20180210_032616_17011635205348499972910.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 155 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J0-20180210_032643_63718412475889566353514.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J1-20180210_032643_637822466597258341358.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 189 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J0-20180210_032654_6489376109310607204153.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J1-20180210_032654_64816886369857385507275.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J2-20180210_032654_64816171475964997990442.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 341 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J2-20180210_032713_7479326845761659335369.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J1-20180210_032713_74711974279670233838728.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J0-20180210_032713_7474120884222495342077.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 238 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J2-20180210_032723_41518003912733181433337.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J0-20180210_032723_4151357855446134362818.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J1-20180210_032723_41518032883018044666650.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 206 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J1-20180210_032732_2817489701129511920195.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J0-20180210_032732_2819007212330289444119.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J2-20180210_032732_28317294837130015842985.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 221 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J2-20180210_032743_95910965044767353317130.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 7 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J0-20180210_032743_9591312809903733174462.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J1-20180210_032743_9597094489564262354351.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 317 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20180210_032844_45113290461949678258131.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20180210_032844_45110439766246498068624.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20180210_032844_4511513196660588107038.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 153 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial/test/temp/junit4-J0-20180210_032859_6417982017950140000839.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 178 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20180210_032901_6598473843637498903536.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20180210_032901_6595560902244207675674.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 11 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20180210_032901_6597602313890762492552.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 260 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J1-20180210_033019_45816954039236032713993.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J0-20180210_033019_45813712641585745280346.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J2-20180210_033019_4588536202192660704930.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 1681 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration
[junit4] 2> 4882 INFO (SUITE-TestTriggerIntegration-seed#[6970629FB1F02A37]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestTriggerIntegration_6970629FB1F02A37-001/init-core-data-001
[junit4] 2> 4884 WARN (SUITE-TestTriggerIntegration-seed#[6970629FB1F02A37]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 4884 INFO (SUITE-TestTriggerIntegration-seed#[6970629FB1F02A37]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 4885 INFO (SUITE-TestTriggerIntegration-seed#[6970629FB1F02A37]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 4955 INFO (SUITE-TestTriggerIntegration-seed#[6970629FB1F02A37]-worker) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 4974 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTrigger
[junit4] 2> 4977 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 4977 DEBUG (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 4992 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 4994 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 5006 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
[junit4] 2> 5007 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 5007 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 5022 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5023 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 5023 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5045 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5065 DEBUG (ScheduledTrigger-25-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5086 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5090 DEBUG (simCloudManagerPool-24-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 5093 DEBUG (simCloudManagerPool-24-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 5093 DEBUG (simCloudManagerPool-24-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
[junit4] 2> 5094 DEBUG (simCloudManagerPool-24-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
[junit4] 2> 5094 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 5106 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5110 INFO (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.s.TestTriggerIntegration TestTriggerAction init
[junit4] 2> 5112 DEBUG (ScheduledTrigger-25-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
[junit4] 2> 5112 DEBUG (ScheduledTrigger-25-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10000_solr
[junit4] 2> 5112 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5112 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 5126 DEBUG (ScheduledTrigger-25-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 5126 DEBUG (ScheduledTrigger-25-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10000_solr
[junit4] 2> 5132 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
[junit4] 2> 5132 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:10000_solr]
[junit4] 2> 5133 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"38a733481f3cbT65sz1dvma7lfw1olzl8uo0ue5",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":996652336935883,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[996652336935883],
[junit4] 2> "nodeNames":["127.0.0.1:10000_solr"]}}
[junit4] 2> 5133 DEBUG (ScheduledTrigger-25-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_lost_trigger]
[junit4] 2> 5153 DEBUG (AutoscalingActionExecutor-26-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"38a733481f3cbT65sz1dvma7lfw1olzl8uo0ue5",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":996652336935883,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[996652336935883],
[junit4] 2> "_enqueue_time_":996653423015033,
[junit4] 2> "nodeNames":["127.0.0.1:10000_solr"]}}
[junit4] 2> 5155 DEBUG (simCloudManagerPool-24-thread-3) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 5156 DEBUG (simCloudManagerPool-24-thread-3) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 5156 DEBUG (simCloudManagerPool-24-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr]
[junit4] 2> 5156 DEBUG (simCloudManagerPool-24-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr]
[junit4] 2> 5156 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 5159 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5159 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 5160 DEBUG (AutoscalingActionExecutor-26-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
[junit4] 2> 5160 DEBUG (AutoscalingActionExecutor-26-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 100ms
[junit4] 2> 5160 DEBUG (AutoscalingActionExecutor-26-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 377 ms for event id=38a733481f3cbT65sz1dvma7lfw1olzl8uo0ue5
[junit4] 2> 5196 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTrigger
[junit4] 2> 5196 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase
[junit4] 2>
[junit4] 2> 5196 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2> 5197 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
[junit4] 2> 5197 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2>
[junit4] 2> 5197 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 1
[junit4] 2> 5197 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 1
[junit4] 2> 5197 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 1
[junit4] 2> 5197 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10000_solr
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: []
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 0
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 2
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 2
[junit4] 2> 5198 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 5199 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_lost_trigger
[junit4] 2> 5199 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 1
[junit4] 2> 5200 INFO (TEST-TestTriggerIntegration.testNodeLostTrigger-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 1
[junit4] 2> 5204 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCooldown
[junit4] 2> 5204 DEBUG (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 5204 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 5205 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 5205 DEBUG (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimNodeStateProvider - removing dead node values: 127.0.0.1:10000_solr
[junit4] 2> 5205 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 5205 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5205 DEBUG (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 5205 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Interrupted
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1259)
[junit4] 2> at java.base/java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:317)
[junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:154)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 5206 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 5207 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 5207 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
[junit4] 2> 5207 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion -1
[junit4] 2> 5207 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 5212 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5212 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 5212 DEBUG (ScheduledTrigger-28-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5232 DEBUG (ScheduledTrigger-28-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5253 DEBUG (ScheduledTrigger-28-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5274 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5295 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5316 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5335 DEBUG (simCloudManagerPool-27-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 5336 DEBUG (simCloudManagerPool-27-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 5336 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5337 DEBUG (simCloudManagerPool-27-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
[junit4] 2> 5337 DEBUG (simCloudManagerPool-27-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration$TestTriggerAction}], enabled=true}
[junit4] 2> 5337 DEBUG (simCloudManagerPool-27-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
[junit4] 2> 5337 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 5338 INFO (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.s.TestTriggerIntegration TestTriggerAction init
[junit4] 2> 5338 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 5338 DEBUG (ScheduledTrigger-28-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 5339 DEBUG (ScheduledTrigger-28-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 5339 DEBUG (simCloudManagerPool-27-thread-2) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 5339 DEBUG (simCloudManagerPool-27-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 5339 DEBUG (simCloudManagerPool-27-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
[junit4] 2> 5340 DEBUG (simCloudManagerPool-27-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration$TestTriggerAction}], enabled=true}
[junit4] 2> 5340 DEBUG (simCloudManagerPool-27-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
[junit4] 2> 5340 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 5340 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 5356 DEBUG (ScheduledTrigger-28-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 5359 DEBUG (ScheduledTrigger-28-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 5359 DEBUG (ScheduledTrigger-28-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 5360 DEBUG (ScheduledTrigger-28-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10003_solr at time 996664723569533
[junit4] 2> 5377 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 5380 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 5380 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 5380 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:10003_solr] added at times [996664723569533], now=996665753758033
[junit4] 2> 5380 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"38a7616cefb7dT65sz1dvma7lfw1olzl8uo0ue8",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":996664723569533,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[996664723569533],
[junit4] 2> "nodeNames":["127.0.0.1:10003_solr"]}}
[junit4] 2> 5381 DEBUG (ScheduledTrigger-28-thread-3) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_cooldown_trigger]
[junit4] 2> 5406 DEBUG (AutoscalingActionExecutor-29-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"38a7616cefb7dT65sz1dvma7lfw1olzl8uo0ue8",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":996664723569533,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[996664723569533],
[junit4] 2> "_enqueue_time_":996665792885383,
[junit4] 2> "nodeNames":["127.0.0.1:10003_solr"]}}
[junit4] 2> 5426 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCooldown
[junit4] 2> 5426 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase
[junit4] 2>
[junit4] 2> 5426 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2> 5426 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
[junit4] 2> 5426 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2>
[junit4] 2> 5426 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 3
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 3
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 0
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: []
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 0
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 2
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 2
[junit4] 2> 5427 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 5428 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_added_cooldown_trigger
[junit4] 2> 5428 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 1
[junit4] 2> 5428 INFO (TEST-TestTriggerIntegration.testCooldown-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 1
[junit4] 2> 5440 DEBUG (AutoscalingActionExecutor-29-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
[junit4] 2> 5440 DEBUG (AutoscalingActionExecutor-29-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 100ms
[junit4] 2> 5440 DEBUG (AutoscalingActionExecutor-29-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 1724 ms for event id=38a7616cefb7dT65sz1dvma7lfw1olzl8uo0ue8
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestTriggerIntegration -Dtests.method=testCooldown -Dtests.seed=6970629FB1F02A37 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko-KP -Dtests.timezone=America/Danmarkshavn -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.24s J0 | TestTriggerIntegration.testCooldown <<<
[junit4] > Throwable #1: java.lang.NullPointerException
[junit4] > at __randomizedtesting.SeedInfo.seed([6970629FB1F02A37:58CE0F7BCF5A5FC5]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testCooldown(TestTriggerIntegration.java:1086)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 5446 INFO (TEST-TestTriggerIntegration.testSearchRate-seed#[6970629FB1F02A37]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSearchRate
[junit4] 2> 5446 DEBUG (TEST-TestTriggerIntegration.testSearchRate-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 5446 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 5450 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 5450 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5450 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 5451 INFO (TEST-TestTriggerIntegration.testSearchRate-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 5451 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 5451 DEBUG (TEST-TestTriggerIntegration.testSearchRate-seed#[6970629FB1F02A37]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 5472 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 5472 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 5474 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10003_solr]
[junit4] 2> 5474 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion -1
[junit4] 2> 5474 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
[junit4] 2> 5486 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5486 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 5487 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5507 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5527 DEBUG (ScheduledTrigger-31-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5548 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5568 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5588 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5609 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5629 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5649 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5654 DEBUG (simCloudManagerPool-30-thread-4) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 5655 DEBUG (simCloudManagerPool-30-thread-4) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 10
[junit4] 2> 5670 DEBUG (ScheduledTrigger-31-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5673 DEBUG (simCloudManagerPool-30-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10003_solr]
[junit4] 2> 5673 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10
[junit4] 2> 5674 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 5674 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10
[junit4] 2> 5691 DEBUG (ScheduledTrigger-31-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 5692 DEBUG (simCloudManagerPool-30-thread-5) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 5693
[...truncated too long message...]
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20180210_042948_0466492743469165359215.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 554 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20180210_043026_6738664544018229516384.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20180210_043026_6739057800197175893121.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20180210_043026_6737987795057673850778.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1261 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20180210_043039_9737947383313051956684.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20180210_043039_97316232772249570105861.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 648 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20180210_043046_65210210682092217127371.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20180210_043046_65210191199734955177889.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20180210_043046_65217391273179463582628.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 559 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20180210_043106_9834036803120215020420.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20180210_043106_98312890555684684418260.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20180210_043106_98312861300070096880955.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 568 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20180210_043118_625576533067065958321.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20180210_043118_6242517484114848741425.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J2-20180210_043118_6253852358023066239016.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 651 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20180210_043126_2096619163640918203391.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20180210_043126_2094384713228170046643.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 12 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20180210_043126_20913106197566488713166.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 603 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20180210_043155_45516311859991112388589.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20180210_043155_45514969859210515993124.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 549 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20180210_043205_8352047627236189431220.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 32346 lines...]
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+42) - Build #
1326 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1326/
Java: 64bit/jdk-10-ea+42 -XX:+UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest.offsetTest
Error Message:
arrays first differed at element [0]; expected:<1.5> but was:<1.0>
Stack Trace:
arrays first differed at element [0]; expected:<1.5> but was:<1.0>
at __randomizedtesting.SeedInfo.seed([CB3B6BE979FBE271:EF46A31875024B27]:0)
at org.junit.internal.ComparisonCriteria.arrayEquals(ComparisonCriteria.java:52)
at org.junit.Assert.internalArrayEquals(Assert.java:416)
at org.junit.Assert.assertArrayEquals(Assert.java:168)
at org.junit.Assert.assertArrayEquals(Assert.java:185)
at org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest.offsetTest(LegacyFieldFacetExtrasCloudTest.java:189)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest.sortTest
Error Message:
{responseHeader={zkConnected=true,status=0,QTime=196,params={_stateVer_=collection1:4,indent=true,o.sr.s.mean=mean(int_id),o.sr.ff.string_sd.sd=desc,o.sr.ff.long_ld.ss=mean,o.sr.s.median=median(int_id),o.sr.ff.double_dd.ss=count,o.sr.ff=[long_ld, float_fd, double_dd, string_sd],rows=0,version=2,q=*:*,o.sr.s.percentile_20=percentile(20,int_id),o.sr.ff.string_sd.ss=percentile_20,o.sr.ff.float_fd.ss=median,olap=true,o.sr.s.count=count(int_id),o.sr.ff.float_fd.sd=desc,o.sr.ff.long_ld.sd=asc,o.sr.ff.double_dd.sd=asc,wt=javabin}},response={numFound=53,start=0,maxScore=1.0,docs=[]},stats={sr={median=8.0,mean=8.735849056603774,count=53,percentile_20=3,fieldFacets={long_ld={20={median=1.0,mean=1.0,count=3,percentile_20=0},21={median=1.0,mean=1.0,count=1,percentile_20=1},1={median=3.0,mean=3.0,count=4,percentile_20=1},0={median=3.0,mean=3.0,count=3,percentile_20=2},3={median=5.0,mean=5.0,count=4,percentile_20=3},4={median=5.0,mean=5.333333333333333,count=3,percentile_20=4},19={median=1.0,mean=6.666666666666667,count=3,percentile_20=0},5={median=7.0,mean=7.0,count=5,percentile_20=6},8={median=8.5,mean=8.5,count=2,percentile_20=8},18={median=9.0,mean=9.0,count=2,percentile_20=0},6={median=9.0,mean=9.0,count=3,percentile_20=8},7={median=10.0,mean=10.0,count=2,percentile_20=9},9={median=12.0,mean=11.333333333333334,count=3,percentile_20=9},10={median=11.5,mean=11.5,count=2,percentile_20=10},11={median=14.0,mean=14.0,count=3,percentile_20=13},13={median=14.0,mean=14.333333333333334,count=3,percentile_20=13},14={median=16.0,mean=16.0,count=2,percentile_20=15},15={median=16.0,mean=16.0,count=1,percentile_20=16},16={median=18.0,mean=18.0,count=1,percentile_20=18},17={median=19.0,mean=19.0,count=3,percentile_20=18}},string_sd={abc2={median=17.0,mean=17.0,count=1,percentile_20=17},abc21={median=15.0,mean=15.0,count=1,percentile_20=15},abc9={median=14.0,mean=14.0,count=3,percentile_20=9},abc20={median=9.0,mean=9.0,count=1,percentile_20=9},abc19={median=13.0,mean=13.333333333333334,count=3,percentile_20=8},abc24={median=10.5,mean=10.5,count=2,percentile_20=8},abc13={median=13.0,mean=12.666666666666666,count=3,percentile_20=7},abc5={median=12.5,mean=12.5,count=2,percentile_20=5},abc0={median=5.0,mean=5.0,count=1,percentile_20=5},abc4={median=6.5,mean=6.5,count=2,percentile_20=4},abc10={median=10.0,mean=9.666666666666666,count=3,percentile_20=4},abc25={median=9.0,mean=9.0,count=3,percentile_20=4},abc15={median=6.5,mean=6.5,count=2,percentile_20=4},abc3={median=8.0,mean=8.0,count=2,percentile_20=3},abc14={median=3.0,mean=3.0,count=1,percentile_20=3},abc8={median=8.0,mean=9.333333333333334,count=3,percentile_20=2},abc18={median=7.0,mean=9.0,count=3,percentile_20=2},abc23={median=7.0,mean=7.0,count=3,percentile_20=2},abc1={median=6.0,mean=7.666666666666667,count=3,percentile_20=1},abc17={median=6.0,mean=6.0,count=3,percentile_20=1},abc12={median=1.0,mean=1.0,count=1,percentile_20=1},abc7={median=1.0,mean=1.0,count=1,percentile_20=1},abc11={median=5.0,mean=7.0,count=3,percentile_20=0},abc16={median=5.0,mean=5.0,count=2,percentile_20=0},abc6={median=0.0,mean=0.0,count=1,percentile_20=0}},double_dd={9.0={median=9.0,mean=9.0,count=1,percentile_20=9},10.0={median=10.0,mean=10.0,count=1,percentile_20=10},6.0={median=9.0,mean=9.0,count=1,percentile_20=9},20.0={median=2.0,mean=2.0,count=1,percentile_20=2},0.0={median=9.0,mean=9.0,count=1,percentile_20=9},14.0={median=2.0,mean=2.0,count=1,percentile_20=2},17.0={median=5.0,mean=5.0,count=1,percentile_20=5},4.0={median=8.5,mean=8.5,count=2,percentile_20=4},5.0={median=9.5,mean=9.5,count=2,percentile_20=5},8.0={median=12.5,mean=12.5,count=2,percentile_20=8},2.0={median=6.5,mean=6.5,count=2,percentile_20=5},11.0={median=17.0,mean=17.0,count=2,percentile_20=14},15.0={median=9.0,mean=9.0,count=2,percentile_20=0},7.0={median=14.5,mean=14.5,count=2,percentile_20=13},16.0={median=2.5,mean=2.5,count=2,percentile_20=1},21.0={median=7.5,mean=7.5,count=2,percentile_20=6},22.0={median=8.5,mean=8.5,count=2,percentile_20=7},18.0={median=3.0,mean=7.0,count=3,percentile_20=0},23.0={median=8.0,mean=7.0,count=3,percentile_20=2},12.0={median=15.0,mean=11.0,count=3,percentile_20=0},1.0={median=5.5,mean=6.25,count=4,percentile_20=1},13.0={median=14.5,mean=12.25,count=4,percentile_20=1},19.0={median=5.5,mean=7.75,count=4,percentile_20=1},3.0={median=9.0,mean=9.0,count=5,percentile_20=6}},float_fd={14.0={median=18.0,mean=18.0,count=3,percentile_20=16},11.0={median=17.0,mean=17.0,count=1,percentile_20=17},13.0={median=14.0,mean=14.0,count=2,percentile_20=13},12.0={median=14.0,mean=14.0,count=1,percentile_20=14},10.0={median=13.0,mean=13.0,count=2,percentile_20=10},7.0={median=13.0,mean=12.333333333333334,count=3,percentile_20=9},6.0={median=12.0,mean=12.0,count=1,percentile_20=12},8.0={median=11.0,mean=11.0,count=2,percentile_20=8},9.0={median=11.0,mean=11.0,count=2,percentile_20=9},18.0={median=9.5,mean=9.5,count=2,percentile_20=1},16.0={median=9.5,mean=9.5,count=2,percentile_20=1},15.0={median=9.5,mean=9.5,count=2,percentile_20=0},5.0={median=9.0,mean=9.0,count=3,percentile_20=5},2.0={median=8.0,mean=7.333333333333333,count=3,percentile_20=4},1.0={median=7.0,mean=5.666666666666667,count=3,percentile_20=1},3.0={median=7.0,mean=7.0,count=5,percentile_20=5},22.0={median=7.0,mean=7.0,count=1,percentile_20=7},4.0={median=6.0,mean=6.0,count=3,percentile_20=4},19.0={median=4.0,mean=7.666666666666667,count=3,percentile_20=0},0.0={median=4.0,mean=4.0,count=2,percentile_20=2},20.0={median=3.0,mean=3.0,count=3,percentile_20=1},21.0={median=3.0,mean=3.0,count=2,percentile_20=2},17.0={median=1.0,mean=1.0,count=2,percentile_20=0}}}}}} expected:<[1.5, 2.0, 3.0, 4.0, 5.0, 5.75, 6.0, 7.0, 8.0, 9.0, 10.0, 10.0, 11.0, 12.0, 13.0, 13.5, 14.25, 14.5, 15.5, 16.5, 17.5, 18.5]> but was:<[1.0, 1.0, 3.0, 3.0, 5.0, 5.333333333333333, 6.666666666666667, 7.0, 8.5, 9.0, 9.0, 10.0, 11.333333333333334, 11.5, 14.0, 14.333333333333334, 16.0, 16.0, 18.0, 19.0]>
Stack Trace:
java.lang.AssertionError: {responseHeader={zkConnected=true,status=0,QTime=196,params={_stateVer_=collection1:4,indent=true,o.sr.s.mean=mean(int_id),o.sr.ff.string_sd.sd=desc,o.sr.ff.long_ld.ss=mean,o.sr.s.median=median(int_id),o.sr.ff.double_dd.ss=count,o.sr.ff=[long_ld, float_fd, double_dd, string_sd],rows=0,version=2,q=*:*,o.sr.s.percentile_20=percentile(20,int_id),o.sr.ff.string_sd.ss=percentile_20,o.sr.ff.float_fd.ss=median,olap=true,o.sr.s.count=count(int_id),o.sr.ff.float_fd.sd=desc,o.sr.ff.long_ld.sd=asc,o.sr.ff.double_dd.sd=asc,wt=javabin}},response={numFound=53,start=0,maxScore=1.0,docs=[]},stats={sr={median=8.0,mean=8.735849056603774,count=53,percentile_20=3,fieldFacets={long_ld={20={median=1.0,mean=1.0,count=3,percentile_20=0},21={median=1.0,mean=1.0,count=1,percentile_20=1},1={median=3.0,mean=3.0,count=4,percentile_20=1},0={median=3.0,mean=3.0,count=3,percentile_20=2},3={median=5.0,mean=5.0,count=4,percentile_20=3},4={median=5.0,mean=5.333333333333333,count=3,percentile_20=4},19={median=1.0,mean=6.666666666666667,count=3,percentile_20=0},5={median=7.0,mean=7.0,count=5,percentile_20=6},8={median=8.5,mean=8.5,count=2,percentile_20=8},18={median=9.0,mean=9.0,count=2,percentile_20=0},6={median=9.0,mean=9.0,count=3,percentile_20=8},7={median=10.0,mean=10.0,count=2,percentile_20=9},9={median=12.0,mean=11.333333333333334,count=3,percentile_20=9},10={median=11.5,mean=11.5,count=2,percentile_20=10},11={median=14.0,mean=14.0,count=3,percentile_20=13},13={median=14.0,mean=14.333333333333334,count=3,percentile_20=13},14={median=16.0,mean=16.0,count=2,percentile_20=15},15={median=16.0,mean=16.0,count=1,percentile_20=16},16={median=18.0,mean=18.0,count=1,percentile_20=18},17={median=19.0,mean=19.0,count=3,percentile_20=18}},string_sd={abc2={median=17.0,mean=17.0,count=1,percentile_20=17},abc21={median=15.0,mean=15.0,count=1,percentile_20=15},abc9={median=14.0,mean=14.0,count=3,percentile_20=9},abc20={median=9.0,mean=9.0,count=1,percentile_20=9},abc19={median=13.0,mean=13.333333333333334,count=3,percentile_20=8},abc24={median=10.5,mean=10.5,count=2,percentile_20=8},abc13={median=13.0,mean=12.666666666666666,count=3,percentile_20=7},abc5={median=12.5,mean=12.5,count=2,percentile_20=5},abc0={median=5.0,mean=5.0,count=1,percentile_20=5},abc4={median=6.5,mean=6.5,count=2,percentile_20=4},abc10={median=10.0,mean=9.666666666666666,count=3,percentile_20=4},abc25={median=9.0,mean=9.0,count=3,percentile_20=4},abc15={median=6.5,mean=6.5,count=2,percentile_20=4},abc3={median=8.0,mean=8.0,count=2,percentile_20=3},abc14={median=3.0,mean=3.0,count=1,percentile_20=3},abc8={median=8.0,mean=9.333333333333334,count=3,percentile_20=2},abc18={median=7.0,mean=9.0,count=3,percentile_20=2},abc23={median=7.0,mean=7.0,count=3,percentile_20=2},abc1={median=6.0,mean=7.666666666666667,count=3,percentile_20=1},abc17={median=6.0,mean=6.0,count=3,percentile_20=1},abc12={median=1.0,mean=1.0,count=1,percentile_20=1},abc7={median=1.0,mean=1.0,count=1,percentile_20=1},abc11={median=5.0,mean=7.0,count=3,percentile_20=0},abc16={median=5.0,mean=5.0,count=2,percentile_20=0},abc6={median=0.0,mean=0.0,count=1,percentile_20=0}},double_dd={9.0={median=9.0,mean=9.0,count=1,percentile_20=9},10.0={median=10.0,mean=10.0,count=1,percentile_20=10},6.0={median=9.0,mean=9.0,count=1,percentile_20=9},20.0={median=2.0,mean=2.0,count=1,percentile_20=2},0.0={median=9.0,mean=9.0,count=1,percentile_20=9},14.0={median=2.0,mean=2.0,count=1,percentile_20=2},17.0={median=5.0,mean=5.0,count=1,percentile_20=5},4.0={median=8.5,mean=8.5,count=2,percentile_20=4},5.0={median=9.5,mean=9.5,count=2,percentile_20=5},8.0={median=12.5,mean=12.5,count=2,percentile_20=8},2.0={median=6.5,mean=6.5,count=2,percentile_20=5},11.0={median=17.0,mean=17.0,count=2,percentile_20=14},15.0={median=9.0,mean=9.0,count=2,percentile_20=0},7.0={median=14.5,mean=14.5,count=2,percentile_20=13},16.0={median=2.5,mean=2.5,count=2,percentile_20=1},21.0={median=7.5,mean=7.5,count=2,percentile_20=6},22.0={median=8.5,mean=8.5,count=2,percentile_20=7},18.0={median=3.0,mean=7.0,count=3,percentile_20=0},23.0={median=8.0,mean=7.0,count=3,percentile_20=2},12.0={median=15.0,mean=11.0,count=3,percentile_20=0},1.0={median=5.5,mean=6.25,count=4,percentile_20=1},13.0={median=14.5,mean=12.25,count=4,percentile_20=1},19.0={median=5.5,mean=7.75,count=4,percentile_20=1},3.0={median=9.0,mean=9.0,count=5,percentile_20=6}},float_fd={14.0={median=18.0,mean=18.0,count=3,percentile_20=16},11.0={median=17.0,mean=17.0,count=1,percentile_20=17},13.0={median=14.0,mean=14.0,count=2,percentile_20=13},12.0={median=14.0,mean=14.0,count=1,percentile_20=14},10.0={median=13.0,mean=13.0,count=2,percentile_20=10},7.0={median=13.0,mean=12.333333333333334,count=3,percentile_20=9},6.0={median=12.0,mean=12.0,count=1,percentile_20=12},8.0={median=11.0,mean=11.0,count=2,percentile_20=8},9.0={median=11.0,mean=11.0,count=2,percentile_20=9},18.0={median=9.5,mean=9.5,count=2,percentile_20=1},16.0={median=9.5,mean=9.5,count=2,percentile_20=1},15.0={median=9.5,mean=9.5,count=2,percentile_20=0},5.0={median=9.0,mean=9.0,count=3,percentile_20=5},2.0={median=8.0,mean=7.333333333333333,count=3,percentile_20=4},1.0={median=7.0,mean=5.666666666666667,count=3,percentile_20=1},3.0={median=7.0,mean=7.0,count=5,percentile_20=5},22.0={median=7.0,mean=7.0,count=1,percentile_20=7},4.0={median=6.0,mean=6.0,count=3,percentile_20=4},19.0={median=4.0,mean=7.666666666666667,count=3,percentile_20=0},0.0={median=4.0,mean=4.0,count=2,percentile_20=2},20.0={median=3.0,mean=3.0,count=3,percentile_20=1},21.0={median=3.0,mean=3.0,count=2,percentile_20=2},17.0={median=1.0,mean=1.0,count=2,percentile_20=0}}}}}} expected:<[1.5, 2.0, 3.0, 4.0, 5.0, 5.75, 6.0, 7.0, 8.0, 9.0, 10.0, 10.0, 11.0, 12.0, 13.0, 13.5, 14.25, 14.5, 15.5, 16.5, 17.5, 18.5]> but was:<[1.0, 1.0, 3.0, 3.0, 5.0, 5.333333333333333, 6.666666666666667, 7.0, 8.5, 9.0, 9.0, 10.0, 11.333333333333334, 11.5, 14.0, 14.333333333333334, 16.0, 16.0, 18.0, 19.0]>
at __randomizedtesting.SeedInfo.seed([CB3B6BE979FBE271:BB2C73C9A019BEA2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest.sortTest(LegacyFieldFacetExtrasCloudTest.java:235)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 17758 lines...]
[junit4] Suite: org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/J1/temp/solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest_CB3B6BE979FBE271-001/init-core-data-001
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LegacyFieldFacetExtrasCloudTest -Dtests.method=offsetTest -Dtests.seed=CB3B6BE979FBE271 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mzn-IR -Dtests.timezone=Atlantic/Bermuda -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.49s J1 | LegacyFieldFacetExtrasCloudTest.offsetTest <<<
[junit4] > Throwable #1: arrays first differed at element [0]; expected:<1.5> but was:<1.0>
[junit4] > at __randomizedtesting.SeedInfo.seed([CB3B6BE979FBE271:EF46A31875024B27]:0)
[junit4] > at org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest.offsetTest(LegacyFieldFacetExtrasCloudTest.java:189)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LegacyFieldFacetExtrasCloudTest -Dtests.method=sortTest -Dtests.seed=CB3B6BE979FBE271 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mzn-IR -Dtests.timezone=Atlantic/Bermuda -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.29s J1 | LegacyFieldFacetExtrasCloudTest.sortTest <<<
[junit4] > Throwable #1: java.lang.AssertionError: {responseHeader={zkConnected=true,status=0,QTime=196,params={_stateVer_=collection1:4,indent=true,o.sr.s.mean=mean(int_id),o.sr.ff.string_sd.sd=desc,o.sr.ff.long_ld.ss=mean,o.sr.s.median=median(int_id),o.sr.ff.double_dd.ss=count,o.sr.ff=[long_ld, float_fd, double_dd, string_sd],rows=0,version=2,q=*:*,o.sr.s.percentile_20=percentile(20,int_id),o.sr.ff.string_sd.ss=percentile_20,o.sr.ff.float_fd.ss=median,olap=true,o.sr.s.count=count(int_id),o.sr.ff.float_fd.sd=desc,o.sr.ff.long_ld.sd=asc,o.sr.ff.double_dd.sd=asc,wt=javabin}},response={numFound=53,start=0,maxScore=1.0,docs=[]},stats={sr={median=8.0,mean=8.735849056603774,count=53,percentile_20=3,fieldFacets={long_ld={20={median=1.0,mean=1.0,count=3,percentile_20=0},21={median=1.0,mean=1.0,count=1,percentile_20=1},1={median=3.0,mean=3.0,count=4,percentile_20=1},0={median=3.0,mean=3.0,count=3,percentile_20=2},3={median=5.0,mean=5.0,count=4,percentile_20=3},4={median=5.0,mean=5.333333333333333,count=3,percentile_20=4},19={median=1.0,mean=6.666666666666667,count=3,percentile_20=0},5={median=7.0,mean=7.0,count=5,percentile_20=6},8={median=8.5,mean=8.5,count=2,percentile_20=8},18={median=9.0,mean=9.0,count=2,percentile_20=0},6={median=9.0,mean=9.0,count=3,percentile_20=8},7={median=10.0,mean=10.0,count=2,percentile_20=9},9={median=12.0,mean=11.333333333333334,count=3,percentile_20=9},10={median=11.5,mean=11.5,count=2,percentile_20=10},11={median=14.0,mean=14.0,count=3,percentile_20=13},13={median=14.0,mean=14.333333333333334,count=3,percentile_20=13},14={median=16.0,mean=16.0,count=2,percentile_20=15},15={median=16.0,mean=16.0,count=1,percentile_20=16},16={median=18.0,mean=18.0,count=1,percentile_20=18},17={median=19.0,mean=19.0,count=3,percentile_20=18}},string_sd={abc2={median=17.0,mean=17.0,count=1,percentile_20=17},abc21={median=15.0,mean=15.0,count=1,percentile_20=15},abc9={median=14.0,mean=14.0,count=3,percentile_20=9},abc20={median=9.0,mean=9.0,count=1,percentile_20=9},abc19={median=13.0,mean=13.333333333333334,count=3,percentile_20=8},abc24={median=10.5,mean=10.5,count=2,percentile_20=8},abc13={median=13.0,mean=12.666666666666666,count=3,percentile_20=7},abc5={median=12.5,mean=12.5,count=2,percentile_20=5},abc0={median=5.0,mean=5.0,count=1,percentile_20=5},abc4={median=6.5,mean=6.5,count=2,percentile_20=4},abc10={median=10.0,mean=9.666666666666666,count=3,percentile_20=4},abc25={median=9.0,mean=9.0,count=3,percentile_20=4},abc15={median=6.5,mean=6.5,count=2,percentile_20=4},abc3={median=8.0,mean=8.0,count=2,percentile_20=3},abc14={median=3.0,mean=3.0,count=1,percentile_20=3},abc8={median=8.0,mean=9.333333333333334,count=3,percentile_20=2},abc18={median=7.0,mean=9.0,count=3,percentile_20=2},abc23={median=7.0,mean=7.0,count=3,percentile_20=2},abc1={median=6.0,mean=7.666666666666667,count=3,percentile_20=1},abc17={median=6.0,mean=6.0,count=3,percentile_20=1},abc12={median=1.0,mean=1.0,count=1,percentile_20=1},abc7={median=1.0,mean=1.0,count=1,percentile_20=1},abc11={median=5.0,mean=7.0,count=3,percentile_20=0},abc16={median=5.0,mean=5.0,count=2,percentile_20=0},abc6={median=0.0,mean=0.0,count=1,percentile_20=0}},double_dd={9.0={median=9.0,mean=9.0,count=1,percentile_20=9},10.0={median=10.0,mean=10.0,count=1,percentile_20=10},6.0={median=9.0,mean=9.0,count=1,percentile_20=9},20.0={median=2.0,mean=2.0,count=1,percentile_20=2},0.0={median=9.0,mean=9.0,count=1,percentile_20=9},14.0={median=2.0,mean=2.0,count=1,percentile_20=2},17.0={median=5.0,mean=5.0,count=1,percentile_20=5},4.0={median=8.5,mean=8.5,count=2,percentile_20=4},5.0={median=9.5,mean=9.5,count=2,percentile_20=5},8.0={median=12.5,mean=12.5,count=2,percentile_20=8},2.0={median=6.5,mean=6.5,count=2,percentile_20=5},11.0={median=17.0,mean=17.0,count=2,percentile_20=14},15.0={median=9.0,mean=9.0,count=2,percentile_20=0},7.0={median=14.5,mean=14.5,count=2,percentile_20=13},16.0={median=2.5,mean=2.5,count=2,percentile_20=1},21.0={median=7.5,mean=7.5,count=2,percentile_20=6},22.0={median=8.5,mean=8.5,count=2,percentile_20=7},18.0={median=3.0,mean=7.0,count=3,percentile_20=0},23.0={median=8.0,mean=7.0,count=3,percentile_20=2},12.0={median=15.0,mean=11.0,count=3,percentile_20=0},1.0={median=5.5,mean=6.25,count=4,percentile_20=1},13.0={median=14.5,mean=12.25,count=4,percentile_20=1},19.0={median=5.5,mean=7.75,count=4,percentile_20=1},3.0={median=9.0,mean=9.0,count=5,percentile_20=6}},float_fd={14.0={median=18.0,mean=18.0,count=3,percentile_20=16},11.0={median=17.0,mean=17.0,count=1,percentile_20=17},13.0={median=14.0,mean=14.0,count=2,percentile_20=13},12.0={median=14.0,mean=14.0,count=1,percentile_20=14},10.0={median=13.0,mean=13.0,count=2,percentile_20=10},7.0={median=13.0,mean=12.333333333333334,count=3,percentile_20=9},6.0={median=12.0,mean=12.0,count=1,percentile_20=12},8.0={median=11.0,mean=11.0,count=2,percentile_20=8},9.0={median=11.0,mean=11.0,count=2,percentile_20=9},18.0={median=9.5,mean=9.5,count=2,percentile_20=1},16.0={median=9.5,mean=9.5,count=2,percentile_20=1},15.0={median=9.5,mean=9.5,count=2,percentile_20=0},5.0={median=9.0,mean=9.0,count=3,percentile_20=5},2.0={median=8.0,mean=7.333333333333333,count=3,percentile_20=4},1.0={median=7.0,mean=5.666666666666667,count=3,percentile_20=1},3.0={median=7.0,mean=7.0,count=5,percentile_20=5},22.0={median=7.0,mean=7.0,count=1,percentile_20=7},4.0={median=6.0,mean=6.0,count=3,percentile_20=4},19.0={median=4.0,mean=7.666666666666667,count=3,percentile_20=0},0.0={median=4.0,mean=4.0,count=2,percentile_20=2},20.0={median=3.0,mean=3.0,count=3,percentile_20=1},21.0={median=3.0,mean=3.0,count=2,percentile_20=2},17.0={median=1.0,mean=1.0,count=2,percentile_20=0}}}}}} expected:<[1.5, 2.0, 3.0, 4.0, 5.0, 5.75, 6.0, 7.0, 8.0, 9.0, 10.0, 10.0, 11.0, 12.0, 13.0, 13.5, 14.25, 14.5, 15.5, 16.5, 17.5, 18.5]> but was:<[1.0, 1.0, 3.0, 3.0, 5.0, 5.333333333333333, 6.666666666666667, 7.0, 8.5, 9.0, 9.0, 10.0, 11.333333333333334, 11.5, 14.0, 14.333333333333334, 16.0, 16.0, 18.0, 19.0]>
[junit4] > at __randomizedtesting.SeedInfo.seed([CB3B6BE979FBE271:BB2C73C9A019BEA2]:0)
[junit4] > at org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest.sortTest(LegacyFieldFacetExtrasCloudTest.java:235)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/J1/temp/solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest_CB3B6BE979FBE271-001
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=mzn-IR, timezone=Atlantic/Bermuda
[junit4] 2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10-ea (64-bit)/cpus=8,threads=1,free=436072024,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [FloorFunctionTest, DateParseFunctionTest, CastingLongValueStreamTest, OrFunctionTest, LegacyFieldFacetExtrasCloudTest]
[junit4] Completed [28/78 (1!)] on J1 in 18.24s, 3 tests, 2 failures <<< FAILURES!
[...truncated 37917 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.4) - Build # 1325 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1325/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication
Error Message:
Index 0 out-of-bounds for length 0
Stack Trace:
java.lang.IndexOutOfBoundsException: Index 0 out-of-bounds for length 0
at __randomizedtesting.SeedInfo.seed([2BA099565622B897:3FE8C20375250589]:0)
at java.base/jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:64)
at java.base/jdk.internal.util.Preconditions.outOfBoundsCheckIndex(Preconditions.java:70)
at java.base/jdk.internal.util.Preconditions.checkIndex(Preconditions.java:248)
at java.base/java.util.Objects.checkIndex(Objects.java:372)
at java.base/java.util.ArrayList.get(ArrayList.java:440)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([2BA099565622B897:465C3DABEC6A4790]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:241)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 1765 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20180209_195228_1049300571274288979617.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180209_195228_1041189699694899494136.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 5 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20180209_195228_10418314479628733295358.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 295 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J1-20180209_195836_958400457421905277880.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J0-20180209_195836_95817021587443544205584.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J2-20180209_195836_9587881009216461238228.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 1062 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20180209_200326_5414019540738037696813.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20180209_200326_54111205794194811978283.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20180209_200326_54115327102380010393569.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 237 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20180209_200508_6432929235128552096855.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 5 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20180209_200508_6435690843224707882996.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20180209_200508_6437256635016328137552.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 251 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20180209_200520_56813356158531286588751.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 5 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20180209_200520_56815510496110936004574.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20180209_200520_5685351928057087539118.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 162 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20180209_200544_9529813854594339938436.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20180209_200544_95315551646888870565535.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20180209_200544_9523483312458294409426.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 172 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J2-20180209_200548_698645290523201636471.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J1-20180209_200548_69813351369417508567397.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J0-20180209_200548_6981619464462462447.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 173 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20180209_200551_2116429744457110569765.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20180209_200551_21116045561420386622628.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20180209_200551_21118428749292676412016.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 161 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20180209_200603_8855239654547685292347.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20180209_200603_88515326802099563220060.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 162 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20180209_200611_840507169429221426120.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20180209_200611_84012578887230155862723.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20180209_200611_84012865493287652453994.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 177 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20180209_200614_48214412502622443862111.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 203 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20180209_200622_66215886549077270243089.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 19 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20180209_200622_6625093370648113531099.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20180209_200622_66216171458914155870970.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1403 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J2-20180209_200833_22812055885816413619047.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J1-20180209_200833_22812368726806216212044.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J0-20180209_200833_22816615888623332081106.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 250 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J2-20180209_200841_133144441989630227649.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J0-20180209_200841_1331499962765056754653.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J1-20180209_200841_13311846781278847289656.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 257 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J1-20180209_200851_71910277697050231216559.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J2-20180209_200851_7192801056091242235170.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J0-20180209_200851_7191122383776111242825.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 230 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J1-20180209_201055_13710662178826648491517.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 6 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J2-20180209_201055_1371587906993117805660.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J0-20180209_201055_1375086275504080493641.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 173 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J1-20180209_201057_7004670273524243183224.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J2-20180209_201057_70113410152012519808114.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J0-20180209_201057_7003979591884955406413.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 226 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J2-20180209_201102_9532406639135169576057.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J0-20180209_201102_9536541721131135520129.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 11 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J1-20180209_201102_9534431636594386077917.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 182 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J1-20180209_201129_83814408860221245581151.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J0-20180209_201129_8388244226621875556619.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J2-20180209_201129_8385536636801397711882.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 255 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J2-20180209_201143_8025101535205218125848.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J1-20180209_201143_8024442287028375382578.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J0-20180209_201143_8024634597008868699393.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 166 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J1-20180209_201202_40814194546358678741933.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J0-20180209_201202_40818231101347560397757.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J2-20180209_201202_4087257926468152496242.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 155 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J0-20180209_201230_28114990229619410549461.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J1-20180209_201230_28114314362460253158200.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 189 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J1-20180209_201240_22810171282444181041091.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J0-20180209_201240_22812729021337392017465.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J2-20180209_201240_22812295408488168889696.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 338 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J2-20180209_201256_227193250983292113452.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J1-20180209_201256_22711976498663255755932.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J0-20180209_201256_2275383011425472766713.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 235 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J2-20180209_201305_32313904965415322884133.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J0-20180209_201305_3236234371713266236242.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J1-20180209_201305_3231068224042455323920.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 212 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J1-20180209_201313_4775840155519552884294.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J0-20180209_201313_4772442134726713458258.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J2-20180209_201313_4779373624026554312828.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 221 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J2-20180209_201324_98816189511484694215127.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J1-20180209_201324_98812558575026254203910.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 7 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J0-20180209_201324_98818157630588049033215.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 317 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20180209_201421_97915829686539559631913.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20180209_201421_9792348474893473445767.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20180209_201421_9796966582178305088990.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 153 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial/test/temp/junit4-J0-20180209_201439_0933735700143908775162.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 175 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20180209_201440_81415011674166935607853.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20180209_201440_8147118211386242389014.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 11 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20180209_201440_81410148243715269826969.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 251 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J2-20180209_201538_8484828204141357269154.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 12 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J1-20180209_201538_8483316102900021259254.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J0-20180209_201538_84811889011613785182305.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 2216 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> 778625 INFO (SUITE-TestReplicationHandler-seed#[2BA099565622B897]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/init-core-data-001
[junit4] 2> 778626 WARN (SUITE-TestReplicationHandler-seed#[2BA099565622B897]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 778626 INFO (SUITE-TestReplicationHandler-seed#[2BA099565622B897]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 778626 INFO (SUITE-TestReplicationHandler-seed#[2BA099565622B897]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None")
[junit4] 2> 778627 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestIndexFetchWithMasterUrl
[junit4] 2> 778628 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/collection1
[junit4] 2> 778630 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T19:27:37-02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 778636 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 778636 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 778636 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 778636 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b0f49a0{/solr,null,AVAILABLE}
[junit4] 2> 778637 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1bb7287b{HTTP/1.1,[http/1.1]}{127.0.0.1:36549}
[junit4] 2> 778637 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.Server Started @780293ms
[junit4] 2> 778637 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/collection1/data, hostPort=36549}
[junit4] 2> 778638 ERROR (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 778638 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 778638 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 778638 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 778638 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T20:29:36.155325Z
[junit4] 2> 778638 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/solr.xml
[junit4] 2> 778640 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 778640 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 778640 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 778660 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778666 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778666 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778667 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/.
[junit4] 2> 778667 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 778668 INFO (coreLoadExecutor-2068-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 778672 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 778676 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 778677 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 778677 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/./collection1, trusted=true
[junit4] 2> 778677 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778677 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 778677 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/./collection1/data/]
[junit4] 2> 778678 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=94.6201171875, floorSegmentMB=1.814453125, forceMergeDeletesPctAllowed=12.726986580043791, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 778711 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 778711 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 778711 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 778712 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@35f81f35[collection1] main]
[junit4] 2> 778712 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-001/collection1/conf
[junit4] 2> 778713 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 778713 INFO (coreLoadExecutor-2068-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 778713 INFO (searcherExecutor-2069-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@35f81f35[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 778714 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/collection1
[junit4] 2> 778715 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T19:27:37-02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 778715 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 778715 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 778715 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48706e70{/solr,null,AVAILABLE}
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@795f8c9e{HTTP/1.1,[http/1.1]}{127.0.0.1:40367}
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.Server Started @780372ms
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/collection1/data, hostPort=40367}
[junit4] 2> 778716 ERROR (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T20:29:36.233778Z
[junit4] 2> 778716 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/solr.xml
[junit4] 2> 778718 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 778718 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 778719 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 778739 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778745 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778745 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778746 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/.
[junit4] 2> 778747 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 778747 INFO (coreLoadExecutor-2078-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 778752 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 778757 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 778758 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 778758 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/./collection1, trusted=true
[junit4] 2> 778759 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778759 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 778759 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/./collection1/data/]
[junit4] 2> 778760 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=94.6201171875, floorSegmentMB=1.814453125, forceMergeDeletesPctAllowed=12.726986580043791, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 778791 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 778791 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 778792 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 778792 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6a08b512[collection1] main]
[junit4] 2> 778792 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/collection1/conf
[junit4] 2> 778793 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 778793 INFO (coreLoadExecutor-2078-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 778794 INFO (searcherExecutor-2079-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6a08b512[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 778795 INFO (qtp1320611772-6013) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 778795 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 778795 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 778795 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 778795 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 778795 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 778795 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 778795 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7c74e8b0 commitCommandVersion:0
[junit4] 2> 778796 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@57d4aa0c[collection1] main]
[junit4] 2> 778796 INFO (indexFetcher-2083-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 778797 INFO (searcherExecutor-2079-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@57d4aa0c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 778798 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@795f8c9e{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 778798 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2032339478
[junit4] 2> 778798 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 778798 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@55946ab2: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@24bad2e
[junit4] 2> 778802 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 778802 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5522f191: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3b7e2eff
[junit4] 2> 778805 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 778805 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3cfee45a: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3b1906b
[junit4] 2> 778805 INFO (coreCloseExecutor-2084-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7b4a7bb0
[junit4] 2> 778805 INFO (coreCloseExecutor-2084-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=2068478896
[junit4] 2> 778805 INFO (coreCloseExecutor-2084-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b01fe45: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@6af94767
[junit4] 2> 778815 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@48706e70{/solr,null,UNAVAILABLE}
[junit4] 2> 778815 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 778851 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T19:27:37-02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 778852 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 778852 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 778852 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 778852 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1243a566{/solr,null,AVAILABLE}
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@33b6890a{HTTP/1.1,[http/1.1]}{127.0.0.1:36723}
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.e.j.s.Server Started @780508ms
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/collection1/data, hostPort=36723}
[junit4] 2> 778853 ERROR (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T20:29:36.370575Z
[junit4] 2> 778853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/solr.xml
[junit4] 2> 778855 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 778855 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 778855 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 778873 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778879 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778879 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778880 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/.
[junit4] 2> 778880 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[2BA099565622B897]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 778881 INFO (coreLoadExecutor-2091-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 778886 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 778894 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 778896 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 778896 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/./collection1, trusted=true
[junit4] 2> 778896 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@22ba9106
[junit4] 2> 778896 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 778896 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/./collection1/data/]
[junit4] 2> 778898 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=94.6201171875, floorSegmentMB=1.814453125, forceMergeDeletesPctAllowed=12.726986580043791, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 778935 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 778935 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 778936 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 778936 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4b4b5d90[collection1] main]
[junit4] 2> 778936 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_2BA099565622B897-001/solr-instance-002/collection1/conf
[junit4] 2> 778937 INFO (coreLoadExecutor-2091-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 778937 INFO (searcherExecutor-2092-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4b4b5d90[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 778939 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 778939 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 778940 INFO (qtp1900306933-6052) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 778940 INFO (qtp1900306933-6052) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 778940 INFO (qtp1900306933-6056) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 778940 INFO (qtp1900306933-6056) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1e15153d commitCommandVersion:0
[junit4] 2> 778941 INFO (qtp1900306933-6056) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@51efe2b4[collection1] main]
[junit4] 2> 778941 INFO (qtp1900306933-6056) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 778942 INFO (searcherExecutor-2092-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@51efe2b4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 778942 INFO (qtp1900306933-6056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
[junit4] 2> 778943 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 778944 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 778944 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 778944 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 778944 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 778945 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 778945 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 778945 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 778945 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 778945 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 778946 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 778946 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
[junit4] 2> 778946 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
[junit4] 2> 778946 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
[junit4] 2> 778946 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
[junit4] 2> 778946 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
[junit4] 2> 778947 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
[junit4] 2> 778947 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
[junit4] 2> 778947 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
[junit4] 2> 778947 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
[junit4] 2> 778947 INFO (qtp1320611772-6018) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
[junit4] 2> 778947 INFO (qtp1320611772-6019) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt
[...truncated too long message...]
4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20180209_211346_6727028079861047878323.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 554 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20180209_211455_6201772728780396662595.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20180209_211455_62014026855582802913043.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20180209_211455_62013080503870454510754.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1261 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20180209_211516_3299121546147445239622.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20180209_211516_3284700147518224584871.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 651 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20180209_211524_36914608839475091914020.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20180209_211524_36911690643847731653322.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20180209_211524_36918002674699776734770.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 559 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20180209_211548_1157564387837945911895.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20180209_211548_1151411563886666478225.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20180209_211548_11513993980697417687069.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 568 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20180209_211602_1794478637445819909197.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J2-20180209_211602_17912827199490526353731.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20180209_211602_17910462726515325357585.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 656 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20180209_211613_2139059639208313698977.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20180209_211613_21316292276312083906092.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20180209_211613_2135095114647278931149.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 603 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20180209_211642_23610265516653510254628.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20180209_211642_23614721495089507776691.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 549 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20180209_211655_70816207149283169528690.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 32346 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_162) - Build # 1324
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1324/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost
Error Message:
The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
at __randomizedtesting.SeedInfo.seed([F999C5ADD23F7BC1:C959242F5A4D9A9D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost(ComputePlanActionTest.java:291)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([F999C5ADD23F7BC1:94656150687784C6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:241)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12728 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/init-core-data-001
[junit4] 2> 558025 WARN (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
[junit4] 2> 558025 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 558027 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 558027 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 558028 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001
[junit4] 2> 558028 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 558028 INFO (Thread-974) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 558028 INFO (Thread-974) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 558037 ERROR (Thread-974) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 558128 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:35055
[junit4] 2> 558147 INFO (zkConnectionManagerCallback-785-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558159 INFO (jetty-launcher-782-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 558208 INFO (jetty-launcher-782-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 558208 INFO (jetty-launcher-782-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 558208 INFO (jetty-launcher-782-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 558208 INFO (jetty-launcher-782-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24a4c353{/solr,null,AVAILABLE}
[junit4] 2> 558210 INFO (jetty-launcher-782-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@48cd7a85{SSL,[ssl, http/1.1]}{127.0.0.1:37965}
[junit4] 2> 558210 INFO (jetty-launcher-782-thread-1) [ ] o.e.j.s.Server Started @560193ms
[junit4] 2> 558210 INFO (jetty-launcher-782-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37965}
[junit4] 2> 558210 ERROR (jetty-launcher-782-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 558210 INFO (jetty-launcher-782-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 558210 INFO (jetty-launcher-782-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 558210 INFO (jetty-launcher-782-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 558210 INFO (jetty-launcher-782-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T16:48:07.712Z
[junit4] 2> 558217 INFO (zkConnectionManagerCallback-787-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558217 INFO (jetty-launcher-782-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 558245 INFO (jetty-launcher-782-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35055/solr
[junit4] 2> 558272 INFO (zkConnectionManagerCallback-791-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558292 INFO (zkConnectionManagerCallback-793-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558360 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 558360 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37965_solr
[junit4] 2> 558360 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer Overseer (id=72120380669558787-127.0.0.1:37965_solr-n_0000000000) starting
[junit4] 2> 558366 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 558383 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37965_solr
[junit4] 2> 558383 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 558389 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 558390 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: []
[junit4] 2> 558390 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 558390 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 558391 INFO (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 558424 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 558426 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 558426 DEBUG (ScheduledTrigger-1372-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 558460 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37965.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 558467 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37965.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 558467 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37965.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 558469 INFO (jetty-launcher-782-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001/node1/.
[junit4] 2> 558518 INFO (zkConnectionManagerCallback-797-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558530 INFO (zkConnectionManagerCallback-801-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558531 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 558531 INFO (SUITE-ComputePlanActionTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35055/solr ready
[junit4] 2> 558554 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLost
[junit4] 2> 558555 DEBUG (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 558555 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 558555 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 558581 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 558582 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 558582 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 558728 INFO (qtp313399886-3476) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=4
[junit4] 2> 558731 DEBUG (qtp313399886-3481) [n:127.0.0.1:37965_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 558732 INFO (qtp313399886-3481) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=84
[junit4] 2> 558732 DEBUG (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 558732 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 558732 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 558732 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 558732 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 558735 INFO (qtp313399886-3480) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 558735 DEBUG (qtp313399886-3481) [n:127.0.0.1:37965_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 558735 INFO (qtp313399886-3481) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 558736 DEBUG (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 558736 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 558736 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 558737 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 558737 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 558737 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 558764 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 558764 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 558764 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 558767 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@969f911{/solr,null,AVAILABLE}
[junit4] 2> 558768 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@19579f63{SSL,[ssl, http/1.1]}{127.0.0.1:41713}
[junit4] 2> 558768 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.Server Started @560751ms
[junit4] 2> 558768 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41713}
[junit4] 2> 558768 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 558768 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 558768 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 558768 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 558768 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T16:48:08.270Z
[junit4] 2> 558786 INFO (zkConnectionManagerCallback-804-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558786 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 558801 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35055/solr
[junit4] 2> 558803 INFO (zkConnectionManagerCallback-808-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558820 INFO (zkConnectionManagerCallback-810-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558826 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 558827 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:41713_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 558831 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:41713_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41713_solr
[junit4] 2> 558831 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:41713_solr"} current state version: 0
[junit4] 2> 558831 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:41713_solr
[junit4] 2> 558832 INFO (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 558852 INFO (zkCallback-800-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 558853 INFO (zkCallback-809-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 558853 INFO (zkCallback-800-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 558889 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:41713_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41713.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 558898 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:41713_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41713.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 558898 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:41713_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41713.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 558899 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:41713_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001/node2/.
[junit4] 2> 558976 INFO (qtp313399886-3476) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 559019 INFO (qtp896617665-3520) [n:127.0.0.1:41713_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 559024 DEBUG (qtp313399886-3479) [n:127.0.0.1:37965_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 559027 INFO (qtp313399886-3479) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=63
[junit4] 2> 559027 DEBUG (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 559028 INFO (qtp313399886-3481) [n:127.0.0.1:37965_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 559060 INFO (OverseerThreadFactory-1374-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testNodeLost
[junit4] 2> 559068 DEBUG (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:41713_solr, 127.0.0.1:37965_solr]
[junit4] 2> 559068 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 559098 INFO (qtp313399886-3480) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 559108 DEBUG (ScheduledTrigger-1372-thread-1) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 559116 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 559125 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 559128 DEBUG (OverseerAutoScalingTriggerThread-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 559168 INFO (OverseerThreadFactory-1374-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 958049107 sessionWrapper.createTime 958049068849091, this.sessionWrapper.createTime 958049068849091
[junit4] 2> 559176 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"testNodeLost",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 559177 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeLost
[junit4] 2> 559177 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/testNodeLost/state.json
[junit4] 2> 559279 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 559279 INFO (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 559280 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 559280 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 559281 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 559281 INFO (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 559282 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 559282 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 559382 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 0
[junit4] 2> 559496 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 559497 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 559503 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 559503 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 559503 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":"testNodeLost_shard1_replica_n1","base_url":"https://127.0.0.1:37965/solr","node_name":"127.0.0.1:37965_solr","state":"down","type":"NRT"}
[junit4] 2> 559503 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 559504 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n3&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 559505 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 559507 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "node_name":"127.0.0.1:41713_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 559507 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "node_name":"127.0.0.1:41713_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 559507 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n3","base_url":"https://127.0.0.1:41713/solr","node_name":"127.0.0.1:41713_solr","state":"down","type":"NRT"}
[junit4] 2> 559507 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "node_name":"127.0.0.1:41713_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 559607 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 1
[junit4] 2> 559608 INFO (zkCallback-809-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 559608 INFO (zkCallback-792-thread-2-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 559608 INFO (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 559608 INFO (zkCallback-809-thread-2-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 560110 DEBUG (ScheduledTrigger-1372-thread-2) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 560509 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 560513 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 560551 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n1] Schema name=minimal
[junit4] 2> 560553 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 560553 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n1' using configuration from collection testNodeLost, trusted=true
[junit4] 2> 560554 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37965.solr.core.testNodeLost.shard1.replica_n1' (registry 'solr.core.testNodeLost.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 560554 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 560554 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001/node1/testNodeLost_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001/node1/./testNodeLost_shard1_replica_n1/data/]
[junit4] 2> 560563 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n3] Schema name=minimal
[junit4] 2> 560564 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 560565 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n3' using configuration from collection testNodeLost, trusted=true
[junit4] 2> 560565 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41713.solr.core.testNodeLost.shard1.replica_n3' (registry 'solr.core.testNodeLost.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 560565 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 560565 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001/node2/testNodeLost_shard1_replica_n3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001/node2/./testNodeLost_shard1_replica_n3/data/]
[junit4] 2> 560596 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 560596 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 560598 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 560598 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 560599 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@43101ccb[testNodeLost_shard1_replica_n3] main]
[junit4] 2> 560600 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 560600 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 560601 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 560601 INFO (searcherExecutor-1384-thread-1-processing-n:127.0.0.1:41713_solr x:testNodeLost_shard1_replica_n3 s:shard1 c:testNodeLost r:core_node4) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n3] Registered new searcher Searcher@43101ccb[testNodeLost_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 560601 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591942725084643328
[junit4] 2> 560607 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost"} current state version: 0
[junit4] 2> 560607 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 560609 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 560609 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 560609 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 560610 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 560611 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@49bfbef6[testNodeLost_shard1_replica_n1] main]
[junit4] 2> 560611 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 560611 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 560612 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 560613 INFO (searcherExecutor-1383-thread-1-processing-n:127.0.0.1:37965_solr x:testNodeLost_shard1_replica_n1 s:shard1 c:testNodeLost r:core_node2) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n1] Registered new searcher Searcher@49bfbef6[testNodeLost_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 560613 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591942725097226240
[junit4] 2> 560708 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 2
[junit4] 2> 560708 INFO (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 560708 INFO (zkCallback-809-thread-2-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 560708 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 560708 INFO (zkCallback-809-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561108 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 561108 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 561108 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41713/solr/testNodeLost_shard1_replica_n3/
[junit4] 2> 561108 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n3 url=https://127.0.0.1:41713/solr START replicas=[https://127.0.0.1:37965/solr/testNodeLost_shard1_replica_n1/] nUpdates=100
[junit4] 2> 561113 DEBUG (ScheduledTrigger-1372-thread-2) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 561115 INFO (qtp313399886-3512) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.S.Request [testNodeLost_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 561409 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n3 url=https://127.0.0.1:41713/solr DONE. We have no versions. sync failed.
[junit4] 2> 561409 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 561409 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 561409 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 561411 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41713/solr/testNodeLost_shard1_replica_n3/ shard1
[junit4] 2> 561411 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 561511 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 3
[junit4] 2> 561512 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561512 INFO (zkCallback-809-thread-2-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561512 INFO (zkCallback-809-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561512 INFO (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561561 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 561562 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "node_name":"127.0.0.1:41713_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 561562 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "node_name":"127.0.0.1:41713_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 561562 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n3","base_url":"https://127.0.0.1:41713/solr","node_name":"127.0.0.1:41713_solr","state":"active","type":"NRT","leader":"true"}
[junit4] 2> 561562 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "node_name":"127.0.0.1:41713_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 561621 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 561621 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 561621 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":"testNodeLost_shard1_replica_n1","base_url":"https://127.0.0.1:37965/solr","node_name":"127.0.0.1:37965_solr","state":"active","type":"NRT"}
[junit4] 2> 561621 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37965/solr",
[junit4] 2> "node_name":"127.0.0.1:37965_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:41713/solr",
[junit4] 2> "node_name":"127.0.0.1:41713_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 561643 INFO (qtp313399886-3475) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2146
[junit4] 2> 561647 INFO (qtp896617665-3518) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n3&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2142
[junit4] 2> 561650 INFO (qtp313399886-3481) [n:127.0.0.1:37965_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 561722 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 4
[junit4] 2> 561722 INFO (zkCallback-809-thread-2-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561722 INFO (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561722 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 561722 INFO (zkCallback-809-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 562113 DEBUG (ScheduledTrigger-1372-thread-2) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 562650 INFO (qtp313399886-3481) [n:127.0.0.1:37965_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3621
[junit4] 2> 562652 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 562652 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 562652 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 562653 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 562653 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@703e8ec9{/solr,null,AVAILABLE}
[junit4] 2> 562653 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@596b7c86{SSL,[ssl, http/1.1]}{127.0.0.1:33571}
[junit4] 2> 562653 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.Server Started @564637ms
[junit4] 2> 562653 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33571}
[junit4] 2> 562653 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 562654 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 562654 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 562654 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 562654 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T16:48:12.156Z
[junit4] 2> 562655 INFO (zkConnectionManagerCallback-814-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 562655 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 562664 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35055/solr
[junit4] 2> 562665 INFO (zkConnectionManagerCallback-818-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 562667 INFO (zkConnectionManagerCallback-820-thread-1-processing-n:127.0.0.1:33571_solr) [n:127.0.0.1:33571_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 562669 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:33571_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 562670 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:33571_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 562671 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:33571_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33571_solr
[junit4] 2> 562671 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:33571_solr"} current state version: 0
[junit4] 2> 562671 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:33571_solr
[junit4] 2> 562672 INFO (zkCallback-809-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 562672 INFO (zkCallback-800-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 562672 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 562672 INFO (zkCallback-800-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 562672 INFO (zkCallback-819-thread-1-processing-n:127.0.0.1:33571_solr) [n:127.0.0.1:33571_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 562701 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:33571_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33571.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 562711 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:33571_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33571.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 562711 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:33571_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33571.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ed9eb3
[junit4] 2> 562713 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [n:127.0.0.1:33571_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_F999C5ADD23F7BC1-001/tempDir-001/node3/.
[junit4] 2> 562753 INFO (zkConnectionManagerCallback-824-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 562755 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@19579f63{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 562755 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1514687462
[junit4] 2> 562755 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 562755 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4d4b17e2: rootName = solr_41713, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@60f3c9a7
[junit4] 2> 562760 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 562760 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@25e3b81b: rootName = solr_41713, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3d63d36f
[junit4] 2> 562764 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 562764 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2c3dcff2: rootName = solr_41713, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6635cc35
[junit4] 2> 562764 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41713_solr
[junit4] 2> 562765 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 562765 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:41713_solr"} current state version: 0
[junit4] 2> 562765 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:41713_solr
[junit4] 2> 562765 INFO (zkCallback-819-thread-1-processing-n:127.0.0.1:33571_solr) [n:127.0.0.1:33571_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 562771 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.NodeMutator Update replica state for core_node4:{"core":"testNodeLost_shard1_replica_n3","base_url":"https://127.0.0.1:41713/solr","node_name":"127.0.0.1:41713_solr","state":"active","type":"NRT","leader":"true"} to down
[junit4] 2> 562771 INFO (zkCallback-800-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 562771 INFO (zkCallback-800-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 562771 INFO (zkCallback-809-thread-1-processing-n:127.0.0.1:41713_solr) [n:127.0.0.1:41713_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 562771 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 562771 INFO (coreCloseExecutor-1399-thread-1) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n3] CLOSING SolrCore org.apache.solr.core.SolrCore@7feb19dd
[junit4] 2> 562771 INFO (coreCloseExecutor-1399-thread-1) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeLost.shard1.replica_n3, tag=2146114013
[junit4] 2> 562772 INFO (coreCloseExecutor-1399-thread-1) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@413c101f: rootName = solr_41713, domain = solr.core.testNodeLost.shard1.replica_n3, service url = null, agent id = null] for registry solr.core.testNodeLost.shard1.replica_n3 / com.codahale.metrics.MetricRegistry@e298ad
[junit4] 2> 562778 INFO (coreCloseExecutor-1399-thread-1) [n:127.0.0.1:41713_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeLost.shard1.leader, tag=2146114013
[junit4] 2> 562784 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 562784 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost"} current state version: 0
[junit4] 2> 562785 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@969f911{/solr,null,UNAVAILABLE}
[junit4] 2> 562785 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 562785 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[F999C5ADD23F7BC1]) [ ] o.a.s.c.a.ComputePlanActionTest Stopped_node : 127.0.0.1:41713_solr
[junit4] 2> 562786 INFO (zkConnectionManagerCallback-826-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 562885 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 5
[junit4] 2> 562885 INFO (zkCallback-792-thread-1-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 562885 INFO (zkCallback-792-thread-2-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 563074 INFO (OverseerCollectionConfigSetProcessor-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 563113 DEBUG (ScheduledTrigger-1372-thread-2) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 563113 DEBUG (ScheduledTrigger-1372-thread-2) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:41713_solr
[junit4] 2> 564114 DEBUG (ScheduledTrigger-1372-thread-2) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 565115 DEBUG (ScheduledTrigger-1372-thread-2) [n:127.0.0.1:37965_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 565284 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37965/solr/testNodeLost_shard1_replica_n1/
[junit4] 2> 565284 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 565284 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:37965/solr/testNodeLost_shard1_replica_n1/ has no replicas
[junit4] 2> 565286 INFO (zkCallback-792-thread-3-processing-n:127.0.0.1:37965_solr) [n:127.0.0.1:37965_solr c:testNodeLost s:shard1 r:core_node2 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37965/solr/testNodeLost_shard1_replica_n1/ shard1
[junit4] 2> 565286 DEBUG (OverseerStateUpdate-72120380669558787-127.0.0.1:37965_solr-n_0000000000) [n:127.0.0.1:37965_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "
[...truncated too long message...]
MetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=959149176
[junit4] 2> 927996 INFO (coreCloseExecutor-4098-thread-2) [n:127.0.0.1:41507_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=761753158
[junit4] 2> 928002 INFO (coreCloseExecutor-4097-thread-1) [n:127.0.0.1:40569_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=1517722699
[junit4] 2> 928002 INFO (coreCloseExecutor-4097-thread-2) [n:127.0.0.1:40569_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=271761931
[junit4] 2> 928003 INFO (jetty-closer-1657-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72120404082294791-127.0.0.1:41507_solr-n_0000000000) closing
[junit4] 2> 928004 INFO (OverseerStateUpdate-72120404082294791-127.0.0.1:41507_solr-n_0000000000) [n:127.0.0.1:41507_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41507_solr
[junit4] 2> 928004 INFO (coreCloseExecutor-4099-thread-2) [n:127.0.0.1:36085_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_n1, tag=1117333882
[junit4] 2> 928004 INFO (coreCloseExecutor-4099-thread-2) [n:127.0.0.1:36085_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@653559fc: rootName = solr_36085, domain = solr.core..system.shard1.replica_n1, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@52f9c685
[junit4] 2> 928011 WARN (OverseerAutoScalingTriggerThread-72120404082294791-127.0.0.1:41507_solr-n_0000000000) [n:127.0.0.1:41507_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 928016 DEBUG (jetty-closer-1657-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 928017 INFO (jetty-closer-1657-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4f19990e{/solr,null,UNAVAILABLE}
[junit4] 2> 928018 INFO (jetty-closer-1657-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 928018 INFO (zkCallback-1682-thread-1-processing-n:127.0.0.1:36085_solr) [n:127.0.0.1:36085_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36085_solr
[junit4] 2> 928018 INFO (jetty-closer-1657-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@24abbfb9{/solr,null,UNAVAILABLE}
[junit4] 2> 928019 INFO (jetty-closer-1657-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 928019 INFO (coreCloseExecutor-4099-thread-1) [n:127.0.0.1:36085_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=1837242734
[junit4] 2> 928020 INFO (coreCloseExecutor-4099-thread-2) [n:127.0.0.1:36085_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=1117333882
[junit4] 2> 928022 INFO (jetty-closer-1657-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2f66cc49{/solr,null,UNAVAILABLE}
[junit4] 2> 928022 INFO (jetty-closer-1657-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 928022 ERROR (SUITE-AutoscalingHistoryHandlerTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 928022 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[F999C5ADD23F7BC1]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45693 45693
[junit4] 2> 929769 INFO (Thread-2822) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45693 45693
[junit4] 2> 929770 WARN (Thread-2822) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 10 /solr/collections/.system/terms/shard1
[junit4] 2> 9 /solr/collections/AutoscalingHistoryHandlerTest_collection/terms/shard1
[junit4] 2> 4 /solr/security.json
[junit4] 2> 3 /solr/configs/.system
[junit4] 2> 3 /solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
[junit4] 2> 3 /solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED
[junit4] 2> 3 /solr/configs/.system/managed-schema
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 22 /solr/collections/.system/state.json
[junit4] 2> 22 /solr/collections/AutoscalingHistoryHandlerTest_collection/state.json
[junit4] 2> 11 /solr/clusterprops.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/72120404082294791-127.0.0.1:41507_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/live_nodes
[junit4] 2> 11 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_F999C5ADD23F7BC1-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {action_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), event.source_s=PostingsFormat(name=LuceneFixedGap), type=PostingsFormat(name=Memory), before.actions_ss=FSTOrd50, event.property._enqueue_time__ss=PostingsFormat(name=LuceneVarGapDocFreqInterval), after.actions_ss=PostingsFormat(name=LuceneVarGapDocFreqInterval), stage_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), event.id_s=PostingsFormat(name=LuceneFixedGap), event.property.eventTimes_ss=PostingsFormat(name=Memory), source_s=PostingsFormat(name=LuceneFixedGap), event.type_s=PostingsFormat(name=Memory), id=PostingsFormat(name=LuceneFixedGap), event.property.nodeNames_ss=PostingsFormat(name=Memory)}, docValues:{_version_=DocValuesFormat(name=Memory), event.time_l=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=390, maxMBSortInHeap=7.094032648056865, sim=RandomSimilarity(queryNorm=false): {}, locale=es-PE, timezone=Africa/Algiers
[junit4] 2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=144860464,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [SoftAutoCommitTest, TestPayloadScoreQParserPlugin, CreateRoutedAliasTest, TestSolr4Spatial, TestNumericRangeQuery64, TestConfigSetsAPIExclusivity, SolrJmxReporterTest, TestLegacyFieldCache, TestSimpleTextCodec, ExecutePlanActionTest, AnalyticsQueryTest, DocExpirationUpdateProcessorFactoryTest, LeaderFailoverAfterPartitionTest, SpellCheckCollatorWithCollapseTest, ZkStateWriterTest, PolyFieldTest, TestSweetSpotSimilarityFactory, TestOnReconnectListenerSupport, CurrencyFieldTypeTest, TestConfigSetImmutable, TestLegacyField, TestReplicationHandler, CSVRequestHandlerTest, CachingDirectoryFactoryTest, SliceStateTest, PKIAuthenticationIntegrationTest, QueryParsingTest, DistributedIntervalFacetingTest, TestFieldResource, JvmMetricsTest, TestCorePropertiesReload, BJQParserTest, TestJettySolrRunner, ScriptEngineTest, TriLevelCompositeIdRoutingTest, QueryElevationComponentTest, TestChildDocTransformer, CdcrVersionReplicationTest, AlternateDirectoryTest, TestBulkSchemaConcurrent, SystemInfoHandlerTest, TestSolrCloudWithSecureImpersonation, HdfsBasicDistributedZkTest, TestFastLRUCache, OverseerRolesTest, ResourceLoaderTest, TestHashQParserPlugin, DirectUpdateHandlerOptimizeTest, TestTrieFacet, TestRTGBase, TestImplicitCoreProperties, DistributedDebugComponentTest, TestFunctionQuery, CoreMergeIndexesAdminHandlerTest, SolrCoreTest, SolrMetricManagerTest, DOMUtilTest, TestSystemCollAutoCreate, SolrInfoBeanTest, TestSolrIndexConfig, DistributedFacetSimpleRefinementLongTailTest, TestFoldingMultitermQuery, AtomicUpdateProcessorFactoryTest, SpatialHeatmapFacetsTest, PrimitiveFieldTypeTest, TestSurroundQueryParser, TestSystemIdResolver, HdfsDirectoryTest, TestRuleBasedAuthorizationPlugin, TestElisionMultitermQuery, BasicFunctionalityTest, TestMacroExpander, TestEmbeddedSolrServerAdminHandler, ChaosMonkeySafeLeaderTest, TestReversedWildcardFilterFactory, DirectSolrConnectionTest, SolrShardReporterTest, TestSolrCLIRunExample, CdcrReplicationDistributedZkTest, DistributedFacetPivotSmallTest, PreAnalyzedUpdateProcessorTest, DistributedFacetPivotLargeTest, MetricTriggerTest, DeleteStatusTest, TestManagedStopFilterFactory, TestNRTOpen, TestManagedSchemaAPI, TestQueryUtils, BlockCacheTest, PathHierarchyTokenizerFactoryTest, LargeFieldTest, TestSimpleTrackingShardHandler, TestSubQueryTransformerDistrib, TestImpersonationWithHadoopAuth, UpdateRequestProcessorFactoryTest, TestPerFieldSimilarity, SearchRateTriggerTest, TestNamedUpdateProcessors, AutoscalingHistoryHandlerTest]
[junit4] Completed [260/774 (2!)] on J1 in 14.55s, 1 test, 1 failure <<< FAILURES!
[...truncated 49877 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1323
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1323/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseG1GC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=30542, name=jetty-launcher-8519-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=30554, name=jetty-launcher-8519-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=30542, name=jetty-launcher-8519-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=30554, name=jetty-launcher-8519-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
at __randomizedtesting.SeedInfo.seed([75CBBAD444CD9B6E]:0)
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testNormalFailedMove
Error Message:
Collection not found: MoveReplicaHDFSTest_failed_coll_false
Stack Trace:
org.apache.solr.common.SolrException: Collection not found: MoveReplicaHDFSTest_failed_coll_false
at __randomizedtesting.SeedInfo.seed([75CBBAD444CD9B6E:52C0A59C688F0577]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:851)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
at org.apache.solr.cloud.MoveReplicaTest.addDocs(MoveReplicaTest.java:390)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:263)
at org.apache.solr.cloud.MoveReplicaHDFSTest.testNormalFailedMove(MoveReplicaHDFSTest.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeAddedTriggerRestoreState
Error Message:
The trigger did not fire at all
Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
at __randomizedtesting.SeedInfo.seed([75CBBAD444CD9B6E:FDF633AB7E0D7AC3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeAddedTriggerRestoreState(TriggerIntegrationTest.java:426)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13078 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 896192 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_75CBBAD444CD9B6E-001/init-core-data-001
[junit4] 2> 896192 WARN (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=14 numCloses=14
[junit4] 2> 896192 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 896194 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 896194 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_75CBBAD444CD9B6E-001/tempDir-001
[junit4] 2> 896195 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 896197 INFO (Thread-2271) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 896197 INFO (Thread-2271) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 896201 ERROR (Thread-2271) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 896297 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43479
[junit4] 2> 896299 INFO (zkConnectionManagerCallback-1833-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896301 INFO (jetty-launcher-1830-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 896305 INFO (jetty-launcher-1830-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 896320 INFO (jetty-launcher-1830-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 896320 INFO (jetty-launcher-1830-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 896320 INFO (jetty-launcher-1830-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 896321 INFO (jetty-launcher-1830-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16fa809{/solr,null,AVAILABLE}
[junit4] 2> 896322 INFO (jetty-launcher-1830-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@f483ec{HTTP/1.1,[http/1.1]}{127.0.0.1:46449}
[junit4] 2> 896322 INFO (jetty-launcher-1830-thread-2) [ ] o.e.j.s.Server Started @897691ms
[junit4] 2> 896322 INFO (jetty-launcher-1830-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46449}
[junit4] 2> 896322 ERROR (jetty-launcher-1830-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 896322 INFO (jetty-launcher-1830-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 896322 INFO (jetty-launcher-1830-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 896322 INFO (jetty-launcher-1830-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 896322 INFO (jetty-launcher-1830-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T12:56:11.100Z
[junit4] 2> 896325 INFO (jetty-launcher-1830-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 896325 INFO (jetty-launcher-1830-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 896325 INFO (jetty-launcher-1830-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 896325 INFO (jetty-launcher-1830-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1df7b44{/solr,null,AVAILABLE}
[junit4] 2> 896325 INFO (jetty-launcher-1830-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@988925{HTTP/1.1,[http/1.1]}{127.0.0.1:42917}
[junit4] 2> 896325 INFO (jetty-launcher-1830-thread-1) [ ] o.e.j.s.Server Started @897695ms
[junit4] 2> 896325 INFO (jetty-launcher-1830-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42917}
[junit4] 2> 896326 ERROR (jetty-launcher-1830-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 896326 INFO (jetty-launcher-1830-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 896326 INFO (jetty-launcher-1830-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 896326 INFO (jetty-launcher-1830-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 896326 INFO (jetty-launcher-1830-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T12:56:11.104Z
[junit4] 2> 896329 INFO (zkConnectionManagerCallback-1835-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896329 INFO (jetty-launcher-1830-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 896336 INFO (zkConnectionManagerCallback-1837-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896337 INFO (jetty-launcher-1830-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 896341 INFO (jetty-launcher-1830-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43479/solr
[junit4] 2> 896343 INFO (zkConnectionManagerCallback-1841-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896345 INFO (jetty-launcher-1830-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43479/solr
[junit4] 2> 896351 INFO (zkConnectionManagerCallback-1844-thread-1-processing-n:127.0.0.1:46449_solr) [n:127.0.0.1:46449_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896351 INFO (zkConnectionManagerCallback-1847-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896366 INFO (zkConnectionManagerCallback-1849-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896381 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 896381 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42917_solr
[junit4] 2> 896382 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.Overseer Overseer (id=72119468634406918-127.0.0.1:42917_solr-n_0000000000) starting
[junit4] 2> 896401 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42917_solr
[junit4] 2> 896404 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 896416 INFO (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 896417 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 896417 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:42917_solr]
[junit4] 2> 896417 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 896417 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 896441 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 896441 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 896444 INFO (jetty-launcher-1830-thread-2) [n:127.0.0.1:46449_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 896445 INFO (jetty-launcher-1830-thread-2) [n:127.0.0.1:46449_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 896447 INFO (jetty-launcher-1830-thread-2) [n:127.0.0.1:46449_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46449_solr
[junit4] 2> 896447 INFO (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 896454 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 896474 INFO (zkCallback-1843-thread-1-processing-n:127.0.0.1:46449_solr) [n:127.0.0.1:46449_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 896592 INFO (jetty-launcher-1830-thread-2) [n:127.0.0.1:46449_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46449.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896601 INFO (jetty-launcher-1830-thread-2) [n:127.0.0.1:46449_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46449.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896601 INFO (jetty-launcher-1830-thread-2) [n:127.0.0.1:46449_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46449.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896602 INFO (jetty-launcher-1830-thread-2) [n:127.0.0.1:46449_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_75CBBAD444CD9B6E-001/tempDir-001/node2/.
[junit4] 2> 896622 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42917.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896631 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42917.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896632 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42917.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896633 INFO (jetty-launcher-1830-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_75CBBAD444CD9B6E-001/tempDir-001/node1/.
[junit4] 2> 896665 INFO (zkConnectionManagerCallback-1855-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896668 INFO (zkConnectionManagerCallback-1859-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896668 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 896669 INFO (SUITE-TriggerIntegrationTest-seed#[75CBBAD444CD9B6E]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43479/solr ready
[junit4] 2> 896679 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerThrottling
[junit4] 2> 896680 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 896680 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 896680 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 896681 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 896681 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 896681 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 896686 INFO (qtp24105637-8541) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 896687 INFO (qtp5432808-8600) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 896688 DEBUG (qtp5432808-8538) [n:127.0.0.1:46449_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 896688 INFO (qtp5432808-8538) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 896688 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 896691 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr]
[junit4] 2> 896691 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 896692 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 896692 INFO (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 896693 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 896693 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 896693 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 896694 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 896697 INFO (qtp24105637-8553) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 896698 INFO (qtp5432808-8546) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 896698 DEBUG (qtp5432808-8544) [n:127.0.0.1:46449_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 896699 INFO (qtp5432808-8544) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 896699 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 896699 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr]
[junit4] 2> 896699 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 896699 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr]
[junit4] 2> 896699 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 896699 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 896700 INFO (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 896700 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 896701 DEBUG (ScheduledTrigger-3875-thread-3) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 896701 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 896701 DEBUG (ScheduledTrigger-3875-thread-3) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 896701 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 896707 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 896707 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 896707 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 896707 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d90e0f{/solr,null,AVAILABLE}
[junit4] 2> 896708 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@b9e0f2{HTTP/1.1,[http/1.1]}{127.0.0.1:44911}
[junit4] 2> 896708 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.Server Started @898077ms
[junit4] 2> 896708 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44911}
[junit4] 2> 896708 ERROR (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 896708 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 896708 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 896708 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 896708 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T12:56:11.486Z
[junit4] 2> 896715 INFO (zkConnectionManagerCallback-1861-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896715 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 896724 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43479/solr
[junit4] 2> 896727 INFO (zkConnectionManagerCallback-1865-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896732 INFO (zkConnectionManagerCallback-1867-thread-1-processing-n:127.0.0.1:44911_solr) [n:127.0.0.1:44911_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 896735 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:44911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 896736 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:44911_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 896737 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:44911_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44911_solr
[junit4] 2> 896738 INFO (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 896738 INFO (zkCallback-1843-thread-1-processing-n:127.0.0.1:46449_solr) [n:127.0.0.1:46449_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 896738 INFO (zkCallback-1858-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 896740 INFO (zkCallback-1866-thread-1-processing-n:127.0.0.1:44911_solr) [n:127.0.0.1:44911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 896854 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:44911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44911.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896862 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:44911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44911.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896862 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:44911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44911.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 896863 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:44911_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_75CBBAD444CD9B6E-001/tempDir-001/node3/.
[junit4] 2> 897695 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 897695 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 897695 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:44911_solr at time 944132910968614
[junit4] 2> 897695 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:44911_solr] added at times [944132910968614], now=944132911165373
[junit4] 2> 897695 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"35aaf12c76f26T40uah7cem4v3qna98zyiep1uc",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":944132910968614,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944132910968614],
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 897696 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_trigger2, node_added_trigger1]
[junit4] 2> 897696 INFO (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 897697 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"35aaf12c76f26T40uah7cem4v3qna98zyiep1uc",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":944132910968614,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944132910968614],
[junit4] 2> "_enqueue_time_":944132911820350,
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 897697 INFO (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger1
[junit4] 2> 897698 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 897698 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 897698 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=35aaf12c76f26T40uah7cem4v3qna98zyiep1uc
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-3) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-3) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:44911_solr at time 944137914240217
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:44911_solr] added at times [944137914240217], now=944137914282583
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"35ab03cff4cd9T40uah7cem4v3qna98zyiep1ue",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":944137914240217,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944137914240217],
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 902698 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_trigger2, node_added_trigger1]
[junit4] 2> 902699 INFO (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 902699 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"35ab03cff4cd9T40uah7cem4v3qna98zyiep1ue",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":944137914240217,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944137914240217],
[junit4] 2> "_enqueue_time_":944137914441143,
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 902699 INFO (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest last action at 1518180972475000000 current time = 1518180977477000000
[junit4] 2> real diff: 5002000000
[junit4] 2> min diff: 4998000000
[junit4] 2> 902699 INFO (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger2
[junit4] 2> 902700 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 902700 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 902700 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=35ab03cff4cd9T40uah7cem4v3qna98zyiep1ue
[junit4] 2> 902701 INFO (qtp24105637-8632) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 902702 INFO (qtp4973687-8606) [n:127.0.0.1:44911_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 902703 INFO (qtp5432808-8544) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 902703 DEBUG (qtp24105637-8553) [n:127.0.0.1:42917_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 902704 INFO (qtp24105637-8553) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 902704 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 902704 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:44911_solr]
[junit4] 2> 902704 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 902704 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:44911_solr]
[junit4] 2> 902705 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:44911_solr]
[junit4] 2> 902705 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 902705 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 902705 INFO (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 902705 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 902705 DEBUG (ScheduledTrigger-3875-thread-3) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: 3
[junit4] 2> 902707 INFO (qtp24105637-8555) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 902708 INFO (qtp4973687-8612) [n:127.0.0.1:44911_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 902710 INFO (qtp5432808-8545) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 902711 DEBUG (qtp5432808-8599) [n:127.0.0.1:46449_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 902711 INFO (qtp5432808-8599) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 902711 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 902711 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:44911_solr]
[junit4] 2> 902711 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 902712 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:44911_solr]
[junit4] 2> 902712 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:44911_solr]
[junit4] 2> 902712 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 902712 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:44911_solr]
[junit4] 2> 902712 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 902713 INFO (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 902713 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 902713 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with currently live nodes: 3
[junit4] 2> 902717 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@b9e0f2{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 902717 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=232277
[junit4] 2> 902717 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 902717 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14caa6e: rootName = solr_44911, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1eac424
[junit4] 2> 902723 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 902723 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f78928: rootName = solr_44911, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1017a8a
[junit4] 2> 902727 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 902727 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@94fae9: rootName = solr_44911, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@162ffc7
[junit4] 2> 902728 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44911_solr
[junit4] 2> 902728 INFO (zkCallback-1858-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 902728 INFO (zkCallback-1843-thread-1-processing-n:127.0.0.1:46449_solr) [n:127.0.0.1:46449_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 902728 INFO (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 902728 INFO (zkCallback-1866-thread-1-processing-n:127.0.0.1:44911_solr) [n:127.0.0.1:44911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 902728 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 902729 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 902729 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d90e0f{/solr,null,UNAVAILABLE}
[junit4] 2> 902729 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 903706 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: 2
[junit4] 2> 903706 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:44911_solr
[junit4] 2> 903706 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:44911_solr]
[junit4] 2> 903707 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"35ab07915cc6bT40uah7cem4v3qna98zyiep1ug",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":944138922347627,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944138922347627],
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 903707 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger2, node_added_trigger2, node_lost_trigger1, node_added_trigger1]
[junit4] 2> 903707 INFO (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 903707 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"35ab07915cc6bT40uah7cem4v3qna98zyiep1ug",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":944138922347627,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944138922347627],
[junit4] 2> "_enqueue_time_":944138922557760,
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 903707 INFO (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_lost_trigger1
[junit4] 2> 903708 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger2 after 5000ms
[junit4] 2> 903708 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 903708 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger1 after 5000ms
[junit4] 2> 903708 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 903708 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=35ab07915cc6bT40uah7cem4v3qna98zyiep1ug
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with currently live nodes: 2
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:44911_solr
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-3) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:44911_solr]
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-3) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: 2
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"35ab1a332738cT40uah7cem4v3qna98zyiep1ui",
[junit4] 2> "source":"node_lost_trigger2",
[junit4] 2> "eventTime":944143923835788,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944143923835788],
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 908708 DEBUG (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger2, node_added_trigger2, node_lost_trigger1, node_added_trigger1]
[junit4] 2> 908708 INFO (ScheduledTrigger-3875-thread-1) [n:127.0.0.1:42917_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 908709 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"35ab1a332738cT40uah7cem4v3qna98zyiep1ui",
[junit4] 2> "source":"node_lost_trigger2",
[junit4] 2> "eventTime":944143923835788,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944143923835788],
[junit4] 2> "_enqueue_time_":944143924093900,
[junit4] 2> "nodeNames":["127.0.0.1:44911_solr"]}}
[junit4] 2> 908709 INFO (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest last action at 1518180978485000000 current time = 1518180983487000000
[junit4] 2> real diff: 5002000000
[junit4] 2> min diff: 4998000000
[junit4] 2> 908709 INFO (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_lost_trigger2
[junit4] 2> 908709 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTriggerThrottling
[junit4] 2> 908709 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger2 after 5000ms
[junit4] 2> 908709 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 908709 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger1 after 5000ms
[junit4] 2> 908709 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 908709 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=35ab1a332738cT40uah7cem4v3qna98zyiep1ui
[junit4] 2> 908720 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTriggerRestoreState
[junit4] 2> 908720 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 7
[junit4] 2> 908720 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 908720 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 908722 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 908722 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 908722 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 908722 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 908723 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 908723 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 908723 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 908723 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7312b7{/solr,null,AVAILABLE}
[junit4] 2> 908724 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@37af54{HTTP/1.1,[http/1.1]}{127.0.0.1:41435}
[junit4] 2> 908724 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.Server Started @910093ms
[junit4] 2> 908724 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41435}
[junit4] 2> 908724 ERROR (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 908724 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 908724 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 908724 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 908724 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T12:56:23.502Z
[junit4] 2> 908725 INFO (zkConnectionManagerCallback-1871-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 908726 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 908733 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43479/solr
[junit4] 2> 908734 INFO (zkConnectionManagerCallback-1875-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 908736 INFO (zkConnectionManagerCallback-1877-thread-1-processing-n:127.0.0.1:41435_solr) [n:127.0.0.1:41435_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 908739 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:41435_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 908740 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:41435_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 908740 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:41435_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41435_solr
[junit4] 2> 908741 INFO (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 908741 INFO (zkCallback-1843-thread-1-processing-n:127.0.0.1:46449_solr) [n:127.0.0.1:46449_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 908741 INFO (zkCallback-1858-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 908741 INFO (zkCallback-1876-thread-1-processing-n:127.0.0.1:41435_solr) [n:127.0.0.1:41435_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 908828 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:41435_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41435.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 908840 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:41435_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41435.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 908840 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:41435_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41435.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3fab2
[junit4] 2> 908842 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [n:127.0.0.1:41435_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_75CBBAD444CD9B6E-001/tempDir-001/node4/.
[junit4] 2> 908877 INFO (qtp26105209-8663) [n:127.0.0.1:41435_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 908878 INFO (qtp24105637-8555) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 908878 INFO (qtp5432808-8599) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 908879 DEBUG (qtp26105209-8638) [n:127.0.0.1:41435_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 908879 INFO (qtp26105209-8638) [n:127.0.0.1:41435_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 908879 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 908879 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr, 127.0.0.1:41435_solr]
[junit4] 2> 908879 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 908880 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@37af54{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 908880 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=22418579
[junit4] 2> 908880 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 908880 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d04a20: rootName = solr_41435, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@12f9c0e
[junit4] 2> 908880 INFO (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 908880 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 908880 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 908880 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_restore_trigger with currently live nodes: 3
[junit4] 2> 908885 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 908885 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14350a5: rootName = solr_41435, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1017a8a
[junit4] 2> 908889 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 908889 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7686e0: rootName = solr_41435, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@162ffc7
[junit4] 2> 908890 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41435_solr
[junit4] 2> 908890 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 908890 INFO (zkCallback-1858-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 908890 INFO (zkCallback-1843-thread-1-processing-n:127.0.0.1:46449_solr) [n:127.0.0.1:46449_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 908890 INFO (zkCallback-1876-thread-1-processing-n:127.0.0.1:41435_solr) [n:127.0.0.1:41435_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 908890 INFO (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 908890 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 908892 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7312b7{/solr,null,UNAVAILABLE}
[junit4] 2> 908892 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 909881 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_restore_trigger with currently live nodes: 2
[junit4] 2> 909881 DEBUG (ScheduledTrigger-3875-thread-4) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:41435_solr
[junit4] 2> 910396 INFO (qtp24105637-8541) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 910398 INFO (qtp5432808-8546) [n:127.0.0.1:46449_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 910398 DEBUG (qtp24105637-8554) [n:127.0.0.1:42917_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 910398 INFO (qtp24105637-8554) [n:127.0.0.1:42917_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 910399 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 910399 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46449_solr, 127.0.0.1:42917_solr]
[junit4] 2> 910399 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
[junit4] 2> 910399 INFO (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 910399 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Adding lost node from marker path: 127.0.0.1:41435_solr
[junit4] 2> 910400 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 910400 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_restore_trigger with currently live nodes: 2
[junit4] 2> 910400 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:41435_solr]
[junit4] 2> 910400 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 910400 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"35ab20805dce7T40uah7cem4v3qna98zyiep1uk",
[junit4] 2> "source":"node_lost_restore_trigger",
[junit4] 2> "eventTime":944145615412455,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944145615412455],
[junit4] 2> "nodeNames":["127.0.0.1:41435_solr"]}}
[junit4] 2> 910400 DEBUG (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_restore_trigger]
[junit4] 2> 910400 INFO (ScheduledTrigger-3875-thread-2) [n:127.0.0.1:42917_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 910400 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"35ab20805dce7T40uah7cem4v3qna98zyiep1uk",
[junit4] 2> "source":"node_lost_restore_trigger",
[junit4] 2> "eventTime":944145615412455,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[944145615412455],
[junit4] 2> "_enqueue_time_":944145615930498,
[junit4] 2> "nodeNames":["127.0.0.1:41435_solr"]}}
[junit4] 2> 910401 INFO (TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTriggerRestoreState
[junit4] 2> 910401 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_restore_trigger after 5000ms
[junit4] 2> 910401 DEBUG (AutoscalingActionExecutor-3876-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=35ab20805dce7T40uah7cem4v3qna98zyiep1uk
[junit4] 2> 910410 INFO (TEST-TriggerIntegrationTest.testMetricTrigger-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMetricTrigger
[junit4] 2> 910410 INFO (TEST-TriggerIntegrationTest.testMetricTrigger-seed#[75CBBAD444CD9B6E]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 10
[junit4] 2> 910410 DEBUG (zkCallback-1848-thread-1-processing-n:127.0.0.1:42917_solr) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 10
[junit4] 2> 910410 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10
[junit4] 2> 910411 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 910411 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 910411 DEBUG (OverseerAutoScalingTriggerThread-72119468634406918-127.0.0.1:42917_solr-n_0000000000) [n:127.0.0.1:42917_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10
[junit4
[...truncated too long message...]
StatsReloadRaceTest, TestQueryUtils, DOMUtilTest, TriLevelCompositeIdRoutingTest, TestLegacyFieldCache, BasicZkTest, PrimUtilsTest, TestSQLHandlerNonCloud, TestSchemaVersionResource, ZkShardTermsTest, TestNamedUpdateProcessors, TestCloudSearcherWarming, SpatialHeatmapFacetsTest, PeerSyncTest, TestDynamicFieldCollectionResource, TestReqParamsAPI, SyncSliceTest, AutoAddReplicasPlanActionTest, TestRuleBasedAuthorizationPlugin, TestPartialUpdateDeduplication, TestBM25SimilarityFactory, DirectoryFactoryTest, HighlighterMaxOffsetTest, DirectSolrConnectionTest, ScriptEngineTest, TermsComponentTest, DistributedDebugComponentTest, TestReload, ResourceLoaderTest, TestReplicationHandler, TestImpersonationWithHadoopAuth, TestCursorMarkWithoutUniqueKey, TestFuzzyAnalyzedSuggestions, PrimitiveFieldTypeTest, TestSolrFieldCacheBean, SolrMetricManagerTest, TestZkChroot, TestRTGBase, DistributedMLTComponentTest, OverseerRolesTest, AsyncCallRequestStatusResponseTest, TestFileDictionaryLookup, TestSkipOverseerOperations, TestSolrCloudSnapshots, AddReplicaTest, SampleTest, JvmMetricsTest, DirectUpdateHandlerOptimizeTest, SmileWriterTest, RequiredFieldsTest, LargeFieldTest, TestPostingsSolrHighlighter, SoftAutoCommitTest, TestCoreBackup, TestMaxScoreQueryParser, HighlighterTest, BlockJoinFacetSimpleTest, TestElisionMultitermQuery, DistributedIntervalFacetingTest, CdcrUpdateLogTest, SOLR749Test, TestLeaderInitiatedRecoveryThread, ZkStateWriterTest, ZkControllerTest, TestManagedStopFilterFactory, TestReplicaProperties, DocumentBuilderTest, TestConfigsApi, TestConfigSetImmutable, TestCorePropertiesReload, TestLegacyField, BitVectorTest, CdcrVersionReplicationTest, SolrGangliaReporterTest, TestSearchPerf, TestPerFieldSimilarity, TestFieldCache, HdfsTlogReplayBufferedWhileIndexingTest, HLLSerializationTest, CoreMergeIndexesAdminHandlerTest, AnalyticsQueryTest, EnumFieldTest, DistributedFacetPivotLargeTest, OverseerTest, CollectionTooManyReplicasTest, TriggerIntegrationTest, TestMacroExpander, TestJavabinTupleStreamParser, RestartWhileUpdatingTest, PropertiesRequestHandlerTest, TestStressLiveNodes, TestOnReconnectListenerSupport, TestDistribIDF, CollectionStateFormat2Test, TestCloudDeleteByQuery, SliceStateTest, BasicFunctionalityTest, SchemaApiFailureTest, TestFieldResource, MultiThreadedOCPTest, TestSolrJ, TestSolr4Spatial, SolrIndexMetricsTest, OverriddenZkACLAndCredentialsProvidersTest, ConcurrentDeleteAndCreateCollectionTest, UpdateLogTest, SortSpecParsingTest, TestReloadDeadlock, TestNoOpRegenerator, TestNestedDocsSort, SolrInfoBeanTest, TestPerFieldSimilarityWithDefaultOverride, TestBulkSchemaConcurrent, LeaderFailoverAfterPartitionTest, CachingDirectoryFactoryTest, TestDistributedGrouping, UUIDUpdateProcessorFallbackTest, TestSolrIndexConfig, TestDistribStateManager, LoggingHandlerTest, FieldMutatingUpdateProcessorTest, ClassificationUpdateProcessorIntegrationTest, CdcrReplicationDistributedZkTest, TestCharFilters, SuggesterTest, LeaderElectionIntegrationTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, LeaderElectionTest, ShardRoutingCustomTest, TestFaceting, TestRecovery, TestHashPartitioner, TermVectorComponentDistributedTest, TestJoin, TestStressVersions, DistributedTermsComponentTest, SimpleFacetsTest, SolrCoreTest, QueryElevationComponentTest, ConvertedLegacyTest, TestFunctionQuery, TestIndexSearcher, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SimplePostToolTest, TestCoreDiscovery, SuggesterFSTTest, TestStressLucene, TestTrie, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, QueryEqualityTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, TestWriterPerf, TestReversedWildcardFilterFactory, TestValueSourceCache, TermVectorComponentTest, FastVectorHighlighterTest, IndexSchemaTest, TestCollationField, ReturnFieldsTest, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, HighlighterConfigTest, TestQuerySenderListener, AlternateDirectoryTest, ResponseLogComponentTest, TestStressRecovery, TestSolrDeletionPolicy2, MultiTermTest, MinimalSchemaTest, ExternalFileFieldSortTest, TestSolrCoreProperties, TestCodecSupport, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, PluginInfoTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CloudExitableDirectoryReaderTest, CollectionsAPISolrJTest, CreateRoutedAliasTest, DeleteNodeTest, DeleteShardTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, LIRRollingUpdatesTest, LeaderElectionContextKeyTest, LeaderInitiatedRecoveryOnShardRestartTest, LegacyCloudClusterPropTest, MissingSegmentRecoveryTest, MoveReplicaHDFSFailoverTest, MoveReplicaTest, OverseerStatusTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverTest, SolrCloudExampleTest, TestCloudRecovery, TestDistribDocBasedVersion, TestMiniSolrCloudClusterSSL, TestPullReplicaErrorHandling, TestSegmentSorting, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=75CBBAD444CD9B6E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-CH -Dtests.timezone=Europe/Ulyanovsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=30542, name=jetty-launcher-8519-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > 2) Thread[id=30554, name=jetty-launcher-8519-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > at __randomizedtesting.SeedInfo.seed([75CBBAD444CD9B6E]:0)
[junit4] Completed [568/774 (3!)] on J1 in 40.55s, 12 tests, 1 error <<< FAILURES!
[...truncated 44726 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1322
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1322/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseG1GC
4 tests failed.
FAILED: org.apache.solr.cloud.TestUtilizeNode.test
Error Message:
no replica should be present in 127.0.0.1:38641_solr
Stack Trace:
java.lang.AssertionError: no replica should be present in 127.0.0.1:38641_solr
at __randomizedtesting.SeedInfo.seed([25A4081A7877CD4A:ADF037C0D68BA0B2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.TestUtilizeNode.test(TestUtilizeNode.java:99)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([25A4081A7877CD4A:C8649F0AC51B5093]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners(TriggerIntegrationTest.java:1053)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([25A4081A7877CD4A:9FA83F95279F1B05]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.junit.Assert.assertNull(Assert.java:562)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData
Error Message:
Node watch should have fired!
Stack Trace:
java.lang.AssertionError: Node watch should have fired!
at __randomizedtesting.SeedInfo.seed([25A4081A7877CD4A:334E7482CF90B40]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData(TestDistribStateManager.java:256)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13052 lines...]
[junit4] Suite: org.apache.solr.cloud.TestUtilizeNode
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/init-core-data-001
[junit4] 2> 1070702 WARN (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=538 numCloses=538
[junit4] 2> 1070702 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1070704 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1070706 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1070706 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001
[junit4] 2> 1070706 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1070707 INFO (Thread-4220) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1070707 INFO (Thread-4220) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1070709 ERROR (Thread-4220) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1070807 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46077
[junit4] 2> 1070809 INFO (zkConnectionManagerCallback-1325-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070815 INFO (jetty-launcher-1322-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1070815 INFO (jetty-launcher-1322-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1070817 INFO (jetty-launcher-1322-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1070826 INFO (jetty-launcher-1322-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1070829 INFO (jetty-launcher-1322-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1070829 INFO (jetty-launcher-1322-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1070829 INFO (jetty-launcher-1322-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1070829 INFO (jetty-launcher-1322-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1070829 INFO (jetty-launcher-1322-thread-3) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1070829 INFO (jetty-launcher-1322-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1070832 INFO (jetty-launcher-1322-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a05457{/solr,null,AVAILABLE}
[junit4] 2> 1070832 INFO (jetty-launcher-1322-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c943ff{/solr,null,AVAILABLE}
[junit4] 2> 1070835 INFO (jetty-launcher-1322-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1070836 INFO (jetty-launcher-1322-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1070836 INFO (jetty-launcher-1322-thread-4) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1070836 INFO (jetty-launcher-1322-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1d92973{SSL,[ssl, http/1.1]}{127.0.0.1:37559}
[junit4] 2> 1070836 INFO (jetty-launcher-1322-thread-1) [ ] o.e.j.s.Server Started @1072078ms
[junit4] 2> 1070836 INFO (jetty-launcher-1322-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37559}
[junit4] 2> 1070836 INFO (jetty-launcher-1322-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@11629fb{/solr,null,AVAILABLE}
[junit4] 2> 1070837 INFO (jetty-launcher-1322-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1d69242{SSL,[ssl, http/1.1]}{127.0.0.1:45513}
[junit4] 2> 1070837 INFO (jetty-launcher-1322-thread-3) [ ] o.e.j.s.Server Started @1072079ms
[junit4] 2> 1070837 INFO (jetty-launcher-1322-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45513}
[junit4] 2> 1070837 ERROR (jetty-launcher-1322-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1070837 INFO (jetty-launcher-1322-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 1070837 INFO (jetty-launcher-1322-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1070837 INFO (jetty-launcher-1322-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1070837 INFO (jetty-launcher-1322-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T08:57:15.312Z
[junit4] 2> 1070837 ERROR (jetty-launcher-1322-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1070838 INFO (jetty-launcher-1322-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 1070838 INFO (jetty-launcher-1322-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1070838 INFO (jetty-launcher-1322-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1070838 INFO (jetty-launcher-1322-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T08:57:15.313Z
[junit4] 2> 1070839 INFO (jetty-launcher-1322-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1070839 INFO (jetty-launcher-1322-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1070839 INFO (jetty-launcher-1322-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1070840 INFO (jetty-launcher-1322-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@13d4d83{SSL,[ssl, http/1.1]}{127.0.0.1:46397}
[junit4] 2> 1070840 INFO (jetty-launcher-1322-thread-4) [ ] o.e.j.s.Server Started @1072083ms
[junit4] 2> 1070840 INFO (jetty-launcher-1322-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46397}
[junit4] 2> 1070841 ERROR (jetty-launcher-1322-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1070841 INFO (jetty-launcher-1322-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 1070841 INFO (jetty-launcher-1322-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1070841 INFO (jetty-launcher-1322-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1070841 INFO (jetty-launcher-1322-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T08:57:15.316Z
[junit4] 2> 1070841 INFO (zkConnectionManagerCallback-1329-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070841 INFO (jetty-launcher-1322-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1070848 INFO (zkConnectionManagerCallback-1331-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070848 INFO (jetty-launcher-1322-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1070851 INFO (jetty-launcher-1322-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e3e180{/solr,null,AVAILABLE}
[junit4] 2> 1070852 INFO (jetty-launcher-1322-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@171ccd5{SSL,[ssl, http/1.1]}{127.0.0.1:32883}
[junit4] 2> 1070852 INFO (jetty-launcher-1322-thread-2) [ ] o.e.j.s.Server Started @1072095ms
[junit4] 2> 1070852 INFO (jetty-launcher-1322-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=32883}
[junit4] 2> 1070853 ERROR (jetty-launcher-1322-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1070853 INFO (jetty-launcher-1322-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 1070853 INFO (jetty-launcher-1322-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1070853 INFO (jetty-launcher-1322-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1070853 INFO (jetty-launcher-1322-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T08:57:15.328Z
[junit4] 2> 1070855 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100376b8e240002, likely client has closed socket
[junit4] 2> 1070863 INFO (jetty-launcher-1322-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46077/solr
[junit4] 2> 1070869 INFO (zkConnectionManagerCallback-1327-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070869 INFO (zkConnectionManagerCallback-1337-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070870 INFO (zkConnectionManagerCallback-1333-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070870 INFO (jetty-launcher-1322-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1070871 INFO (jetty-launcher-1322-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1070879 INFO (jetty-launcher-1322-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46077/solr
[junit4] 2> 1070880 INFO (zkConnectionManagerCallback-1340-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070881 INFO (zkConnectionManagerCallback-1343-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070888 INFO (jetty-launcher-1322-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46077/solr
[junit4] 2> 1070891 INFO (zkConnectionManagerCallback-1346-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070900 INFO (jetty-launcher-1322-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46077/solr
[junit4] 2> 1070915 INFO (zkConnectionManagerCallback-1349-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070916 INFO (zkConnectionManagerCallback-1355-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070918 INFO (zkConnectionManagerCallback-1357-thread-1-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070922 INFO (zkConnectionManagerCallback-1359-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1070937 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1070939 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32883_solr
[junit4] 2> 1070940 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.c.Overseer Overseer (id=72118529123680267-127.0.0.1:32883_solr-n_0000000000) starting
[junit4] 2> 1070941 INFO (jetty-launcher-1322-thread-3) [n:127.0.0.1:45513_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1070942 INFO (jetty-launcher-1322-thread-3) [n:127.0.0.1:45513_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45513_solr
[junit4] 2> 1070978 INFO (jetty-launcher-1322-thread-1) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1070980 INFO (jetty-launcher-1322-thread-1) [n:127.0.0.1:37559_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1070983 INFO (jetty-launcher-1322-thread-1) [n:127.0.0.1:37559_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37559_solr
[junit4] 2> 1071012 INFO (jetty-launcher-1322-thread-4) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1071014 INFO (jetty-launcher-1322-thread-4) [n:127.0.0.1:46397_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1071015 INFO (jetty-launcher-1322-thread-4) [n:127.0.0.1:46397_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46397_solr
[junit4] 2> 1071034 INFO (zkCallback-1358-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1071035 INFO (zkCallback-1345-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1071035 INFO (zkCallback-1339-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 1071084 INFO (zkCallback-1356-thread-1-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1071087 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32883_solr
[junit4] 2> 1071102 INFO (zkCallback-1339-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1071103 INFO (zkCallback-1358-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1071103 INFO (zkCallback-1356-thread-1-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1071104 INFO (zkCallback-1345-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1071141 INFO (jetty-launcher-1322-thread-3) [n:127.0.0.1:45513_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45513.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071154 INFO (jetty-launcher-1322-thread-3) [n:127.0.0.1:45513_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45513.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071154 INFO (jetty-launcher-1322-thread-3) [n:127.0.0.1:45513_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45513.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071155 INFO (jetty-launcher-1322-thread-3) [n:127.0.0.1:45513_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node3/.
[junit4] 2> 1071174 INFO (jetty-launcher-1322-thread-1) [n:127.0.0.1:37559_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37559.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071188 INFO (jetty-launcher-1322-thread-1) [n:127.0.0.1:37559_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37559.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071189 INFO (jetty-launcher-1322-thread-1) [n:127.0.0.1:37559_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37559.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071190 INFO (jetty-launcher-1322-thread-1) [n:127.0.0.1:37559_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node1/.
[junit4] 2> 1071211 INFO (jetty-launcher-1322-thread-4) [n:127.0.0.1:46397_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46397.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071227 INFO (jetty-launcher-1322-thread-4) [n:127.0.0.1:46397_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46397.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071227 INFO (jetty-launcher-1322-thread-4) [n:127.0.0.1:46397_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46397.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071229 INFO (jetty-launcher-1322-thread-4) [n:127.0.0.1:46397_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node4/.
[junit4] 2> 1071479 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32883.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071489 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32883.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071490 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32883.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1071491 INFO (jetty-launcher-1322-thread-2) [n:127.0.0.1:32883_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node2/.
[junit4] 2> 1071539 INFO (zkConnectionManagerCallback-1367-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1071543 INFO (zkConnectionManagerCallback-1371-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1071544 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1071544 INFO (SUITE-TestUtilizeNode-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46077/solr ready
[junit4] 2> 1071633 INFO (qtp24699498-9812) [n:127.0.0.1:37559_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1071639 INFO (qtp24699498-9812) [n:127.0.0.1:37559_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 1071663 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 1071664 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1071666 INFO (zkConnectionManagerCallback-1374-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1071668 INFO (qtp24699498-9816) [n:127.0.0.1:37559_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf1&name=utilizenodecoll&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1071670 INFO (OverseerThreadFactory-3072-thread-2-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection utilizenodecoll
[junit4] 2> 1071670 INFO (OverseerCollectionConfigSetProcessor-72118529123680267-127.0.0.1:32883_solr-n_0000000000) [n:127.0.0.1:32883_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1071776 INFO (OverseerStateUpdate-72118529123680267-127.0.0.1:32883_solr-n_0000000000) [n:127.0.0.1:32883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"utilizenodecoll",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"utilizenodecoll_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45513/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1071778 INFO (OverseerStateUpdate-72118529123680267-127.0.0.1:32883_solr-n_0000000000) [n:127.0.0.1:32883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"utilizenodecoll",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"utilizenodecoll_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:32883/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1071780 INFO (OverseerStateUpdate-72118529123680267-127.0.0.1:32883_solr-n_0000000000) [n:127.0.0.1:32883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"utilizenodecoll",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"utilizenodecoll_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37559/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1071781 INFO (OverseerStateUpdate-72118529123680267-127.0.0.1:32883_solr-n_0000000000) [n:127.0.0.1:32883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"utilizenodecoll",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"utilizenodecoll_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46397/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1071990 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard2_replica_n4&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1071991 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1072061 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard1_replica_n1&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1072061 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard1_replica_n2&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1072061 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1072061 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1072064 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard2_replica_n6&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1072064 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1072167 INFO (zkCallback-1358-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1072167 INFO (zkCallback-1345-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1072167 INFO (zkCallback-1356-thread-1-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1072167 INFO (zkCallback-1339-thread-2-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1072167 INFO (zkCallback-1356-thread-2-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1072168 INFO (zkCallback-1358-thread-2-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1072167 INFO (zkCallback-1339-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1072168 INFO (zkCallback-1345-thread-2-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073009 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1073025 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.s.IndexSchema [utilizenodecoll_shard2_replica_n4] Schema name=cloud-dynamic
[junit4] 2> 1073056 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1073056 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'utilizenodecoll_shard2_replica_n4' using configuration from collection utilizenodecoll, trusted=true
[junit4] 2> 1073057 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37559.solr.core.utilizenodecoll.shard2.replica_n4' (registry 'solr.core.utilizenodecoll.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1073057 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1073057 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.SolrCore [[utilizenodecoll_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node1/utilizenodecoll_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node1/./utilizenodecoll_shard2_replica_n4/data/]
[junit4] 2> 1073075 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1073075 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1073076 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1073090 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.s.IndexSchema [utilizenodecoll_shard1_replica_n2] Schema name=cloud-dynamic
[junit4] 2> 1073123 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.s.IndexSchema [utilizenodecoll_shard2_replica_n6] Schema name=cloud-dynamic
[junit4] 2> 1073147 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.s.IndexSchema [utilizenodecoll_shard1_replica_n1] Schema name=cloud-dynamic
[junit4] 2> 1073161 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1073162 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'utilizenodecoll_shard1_replica_n2' using configuration from collection utilizenodecoll, trusted=true
[junit4] 2> 1073162 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32883.solr.core.utilizenodecoll.shard1.replica_n2' (registry 'solr.core.utilizenodecoll.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1073162 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1073163 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.SolrCore [[utilizenodecoll_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node2/utilizenodecoll_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node2/./utilizenodecoll_shard1_replica_n2/data/]
[junit4] 2> 1073167 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1073168 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1073169 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1073169 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1073169 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'utilizenodecoll_shard2_replica_n6' using configuration from collection utilizenodecoll, trusted=true
[junit4] 2> 1073169 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1073170 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46397.solr.core.utilizenodecoll.shard2.replica_n6' (registry 'solr.core.utilizenodecoll.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1073170 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1073170 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.c.SolrCore [[utilizenodecoll_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node4/utilizenodecoll_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node4/./utilizenodecoll_shard2_replica_n6/data/]
[junit4] 2> 1073172 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cbe100[utilizenodecoll_shard2_replica_n4] main]
[junit4] 2> 1073173 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1073174 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1073174 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1073176 INFO (searcherExecutor-3081-thread-1-processing-n:127.0.0.1:37559_solr x:utilizenodecoll_shard2_replica_n4 s:shard2 c:utilizenodecoll r:core_node7) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.SolrCore [utilizenodecoll_shard2_replica_n4] Registered new searcher Searcher@1cbe100[utilizenodecoll_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1073176 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591913100241534976
[junit4] 2> 1073183 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1073183 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'utilizenodecoll_shard1_replica_n1' using configuration from collection utilizenodecoll, trusted=true
[junit4] 2> 1073184 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45513.solr.core.utilizenodecoll.shard1.replica_n1' (registry 'solr.core.utilizenodecoll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1073184 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1073184 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.c.SolrCore [[utilizenodecoll_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node3/utilizenodecoll_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node3/./utilizenodecoll_shard1_replica_n1/data/]
[junit4] 2> 1073186 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 1073235 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1073235 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1073236 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1073236 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1073239 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@96dac8[utilizenodecoll_shard1_replica_n2] main]
[junit4] 2> 1073240 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1073241 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1073241 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1073243 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1073243 INFO (searcherExecutor-3083-thread-1-processing-n:127.0.0.1:32883_solr x:utilizenodecoll_shard1_replica_n2 s:shard1 c:utilizenodecoll r:core_node5) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.SolrCore [utilizenodecoll_shard1_replica_n2] Registered new searcher Searcher@96dac8[utilizenodecoll_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1073243 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1073243 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591913100311789568
[junit4] 2> 1073244 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1073244 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1073246 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1073246 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1073246 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f04da3[utilizenodecoll_shard2_replica_n6] main]
[junit4] 2> 1073247 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1073247 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1073247 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1073247 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1073248 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1073249 INFO (searcherExecutor-3087-thread-1-processing-n:127.0.0.1:46397_solr x:utilizenodecoll_shard2_replica_n6 s:shard2 c:utilizenodecoll r:core_node8) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.c.SolrCore [utilizenodecoll_shard2_replica_n6] Registered new searcher Searcher@1f04da3[utilizenodecoll_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1073249 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591913100318081024
[junit4] 2> 1073250 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 1073250 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a050b2[utilizenodecoll_shard1_replica_n1] main]
[junit4] 2> 1073250 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1073251 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1073252 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1073252 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591913100321226752
[junit4] 2> 1073254 INFO (searcherExecutor-3088-thread-1-processing-n:127.0.0.1:45513_solr x:utilizenodecoll_shard1_replica_n1 s:shard1 c:utilizenodecoll r:core_node3) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.c.SolrCore [utilizenodecoll_shard1_replica_n1] Registered new searcher Searcher@1a050b2[utilizenodecoll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1073351 INFO (zkCallback-1358-thread-2-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073351 INFO (zkCallback-1356-thread-2-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073351 INFO (zkCallback-1358-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073351 INFO (zkCallback-1345-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073351 INFO (zkCallback-1339-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073351 INFO (zkCallback-1356-thread-3-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073351 INFO (zkCallback-1339-thread-2-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073351 INFO (zkCallback-1345-thread-2-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1073687 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1073687 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1073687 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37559/solr/utilizenodecoll_shard2_replica_n4/
[junit4] 2> 1073687 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=utilizenodecoll_shard2_replica_n4 url=https://127.0.0.1:37559/solr START replicas=[https://127.0.0.1:46397/solr/utilizenodecoll_shard2_replica_n6/] nUpdates=100
[junit4] 2> 1073695 INFO (qtp23071618-9824) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.c.S.Request [utilizenodecoll_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1073750 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1073750 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1073750 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:32883/solr/utilizenodecoll_shard1_replica_n2/
[junit4] 2> 1073751 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=utilizenodecoll_shard1_replica_n2 url=https://127.0.0.1:32883/solr START replicas=[https://127.0.0.1:45513/solr/utilizenodecoll_shard1_replica_n1/] nUpdates=100
[junit4] 2> 1073756 INFO (qtp17491845-9807) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.c.S.Request [utilizenodecoll_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1073988 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=utilizenodecoll_shard2_replica_n4 url=https://127.0.0.1:37559/solr DONE. We have no versions. sync failed.
[junit4] 2> 1073988 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1073988 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1073988 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1073992 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37559/solr/utilizenodecoll_shard2_replica_n4/ shard2
[junit4] 2> 1074051 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=utilizenodecoll_shard1_replica_n2 url=https://127.0.0.1:32883/solr DONE. We have no versions. sync failed.
[junit4] 2> 1074051 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1074051 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1074051 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1074055 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:32883/solr/utilizenodecoll_shard1_replica_n2/ shard1
[junit4] 2> 1074157 INFO (zkCallback-1358-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074157 INFO (zkCallback-1339-thread-2-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074157 INFO (zkCallback-1345-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074157 INFO (zkCallback-1356-thread-2-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074157 INFO (zkCallback-1358-thread-2-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074157 INFO (zkCallback-1356-thread-3-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074157 INFO (zkCallback-1345-thread-2-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074157 INFO (zkCallback-1339-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074192 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1074199 INFO (qtp24699498-9814) [n:127.0.0.1:37559_solr c:utilizenodecoll s:shard2 r:core_node7 x:utilizenodecoll_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard2_replica_n4&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2209
[junit4] 2> 1074206 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1074217 INFO (qtp10155313-9821) [n:127.0.0.1:32883_solr c:utilizenodecoll s:shard1 r:core_node5 x:utilizenodecoll_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard1_replica_n2&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2156
[junit4] 2> 1074264 INFO (qtp17491845-9803) [n:127.0.0.1:45513_solr c:utilizenodecoll s:shard1 r:core_node3 x:utilizenodecoll_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard1_replica_n1&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2203
[junit4] 2> 1074264 INFO (qtp23071618-9822) [n:127.0.0.1:46397_solr c:utilizenodecoll s:shard2 r:core_node8 x:utilizenodecoll_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard2_replica_n6&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2200
[junit4] 2> 1074269 INFO (qtp24699498-9816) [n:127.0.0.1:37559_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1074359 INFO (zkCallback-1358-thread-2-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074359 INFO (zkCallback-1358-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074359 INFO (zkCallback-1339-thread-2-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074359 INFO (zkCallback-1345-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074359 INFO (zkCallback-1345-thread-2-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074359 INFO (zkCallback-1356-thread-2-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074359 INFO (zkCallback-1339-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1074359 INFO (zkCallback-1356-thread-3-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1075269 INFO (qtp24699498-9816) [n:127.0.0.1:37559_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf1&name=utilizenodecoll&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=3601
[junit4] 2> 1075271 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1075272 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1075272 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1075272 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1075272 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14c5e6b{/solr,null,AVAILABLE}
[junit4] 2> 1075273 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5f6eb{SSL,[ssl, http/1.1]}{127.0.0.1:38641}
[junit4] 2> 1075273 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.e.j.s.Server Started @1076516ms
[junit4] 2> 1075273 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38641}
[junit4] 2> 1075274 ERROR (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1075274 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.3.0
[junit4] 2> 1075274 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1075274 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1075274 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T08:57:19.749Z
[junit4] 2> 1075276 INFO (zkConnectionManagerCallback-1376-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1075277 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1075287 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46077/solr
[junit4] 2> 1075288 INFO (zkConnectionManagerCallback-1380-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1075291 INFO (zkConnectionManagerCallback-1382-thread-1-processing-n:127.0.0.1:38641_solr) [n:127.0.0.1:38641_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1075295 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [n:127.0.0.1:38641_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1075297 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [n:127.0.0.1:38641_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1075299 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [n:127.0.0.1:38641_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38641_solr
[junit4] 2> 1075300 INFO (zkCallback-1358-thread-1-processing-n:127.0.0.1:45513_solr) [n:127.0.0.1:45513_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1075300 INFO (zkCallback-1339-thread-1-processing-n:127.0.0.1:37559_solr) [n:127.0.0.1:37559_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1075300 INFO (zkCallback-1356-thread-3-processing-n:127.0.0.1:32883_solr) [n:127.0.0.1:32883_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1075300 INFO (zkCallback-1345-thread-1-processing-n:127.0.0.1:46397_solr) [n:127.0.0.1:46397_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1075300 INFO (zkCallback-1370-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1075300 INFO (zkCallback-1370-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1075301 INFO (zkCallback-1381-thread-1-processing-n:127.0.0.1:38641_solr) [n:127.0.0.1:38641_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1075454 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [n:127.0.0.1:38641_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38641.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1075470 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [n:127.0.0.1:38641_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38641.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1075471 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [n:127.0.0.1:38641_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38641.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@cea561
[junit4] 2> 1075473 INFO (TEST-TestUtilizeNode.test-seed#[25A4081A7877CD4A]) [n:127.0.0.1:38641_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestUtilizeNode_25A4081A7877CD4A-001/tempDir-001/node5/.
[junit4] 2> 1075594 INFO (zkConnectionManagerCallback-1386-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1075600 INFO (qtp10155313-9823) [n:127.0.0.1:32883_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :utilizenode with params node=127.0.0.1:38641_solr&action=UTILIZENODE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1075603 INFO (OverseerCollectionConfigSetProcessor-72118529123680267-127.0.0.1:32883_solr-n_0000000000) [n:127.0.0.1:32883_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1075609 INFO (qtp10155313-9810) [n:127.0.0.1:32883_solr
[...truncated too long message...]
(coreCloseExecutor-8648-thread-1) [n:127.0.0.1:37587_solr c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=8206782
[junit4] 2> 2623087 INFO (jetty-closer-4404-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1981c16{/solr,null,UNAVAILABLE}
[junit4] 2> 2623087 INFO (coreCloseExecutor-8648-thread-2) [n:127.0.0.1:37587_solr c:collection1 s:shard1 r:core_node12 x:collection1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=9127137
[junit4] 2> 2623087 INFO (jetty-closer-4404-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2623088 INFO (jetty-closer-4404-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72118618076217364-127.0.0.1:37587_solr-n_0000000005) closing
[junit4] 2> 2623088 INFO (OverseerStateUpdate-72118618076217364-127.0.0.1:37587_solr-n_0000000005) [n:127.0.0.1:37587_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37587_solr
[junit4] 2> 2623088 WARN (OverseerAutoScalingTriggerThread-72118618076217364-127.0.0.1:37587_solr-n_0000000005) [n:127.0.0.1:37587_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2623090 DEBUG (jetty-closer-4404-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 2623090 INFO (jetty-closer-4404-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@18ac4cb{/solr,null,UNAVAILABLE}
[junit4] 2> 2623091 INFO (jetty-closer-4404-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2623091 ERROR (SUITE-TriggerIntegrationTest-seed#[25A4081A7877CD4A]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2623092 INFO (SUITE-TriggerIntegrationTest-seed#[25A4081A7877CD4A]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36997 36997
[junit4] 2> 2628104 INFO (Thread-7303) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36997 36997
[junit4] 2> 2628105 WARN (Thread-7303) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 36 /solr/collections/collection1/terms/shard1
[junit4] 2> 21 /solr/clusterprops.json
[junit4] 2> 21 /solr/aliases.json
[junit4] 2> 20 /solr/security.json
[junit4] 2> 7 /solr/configs/conf
[junit4] 2> 2 /solr/collections/testMetricTrigger/terms/shard1
[junit4] 2> 2 /solr/collections/testMetricTrigger/terms/shard2
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 107 /solr/collections/collection1/state.json
[junit4] 2> 21 /solr/clusterstate.json
[junit4] 2> 11 /solr/collections/testMetricTrigger/state.json
[junit4] 2> 6 /solr/autoscaling.json
[junit4] 2> 4 /solr/overseer_elect/election/72118618076217370-127.0.0.1:35501_solr-n_0000000007
[junit4] 2> 3 /solr/overseer_elect/election/72118618076217392-127.0.0.1:44127_solr-n_0000000014
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard1/election/72118618076217364-core_node6-n_0000000002
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72118618076217361-core_node4-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/72118618076217364-127.0.0.1:37587_solr-n_0000000005
[junit4] 2> 2 /solr/overseer_elect/election/72118618076217398-127.0.0.1:35301_solr-n_0000000016
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 21 /solr/live_nodes
[junit4] 2> 21 /solr/collections
[junit4] 2> 6 /solr/overseer/queue-work
[junit4] 2> 6 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 6 /solr/overseer/queue
[junit4] 2> 6 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_triggerMR
[junit4] 2> 2 /solr/autoscaling/events/node_added_triggerCTOOR
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_25A4081A7877CD4A-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=BlockTreeOrds(blocksize=128), id=FST50, x_s=BlockTreeOrds(blocksize=128)}, docValues:{}, maxPointsInLeafNode=445, maxMBSortInHeap=5.048030610817544, sim=RandomSimilarity(queryNorm=true): {}, locale=th-TH, timezone=Pacific/Chuuk
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=93782328,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [AddBlockUpdateTest, SuggestComponentContextFilterQueryTest, MigrateRouteKeyTest, TestInPlaceUpdatesDistrib, TestCloudInspectUtil, MetricsConfigTest, TestDistributedMissingSort, CoreAdminHandlerTest, TestPushWriter, TestValueSourceCache, TestDFISimilarityFactory, TestXmlQParser, HdfsAutoAddReplicasIntegrationTest, OverseerStatusTest, HDFSCollectionsAPITest, DirectSolrSpellCheckerTest, TestSchemalessBufferedUpdates, MoveReplicaHDFSTest, DistanceUnitsTest, CdcrReplicationHandlerTest, CdcrBidirectionalTest, ShowFileRequestHandlerTest, TestApiFramework, NotRequiredUniqueKeyTest, DistanceFunctionTest, DateFieldTest, ManagedSchemaRoundRobinCloudTest, TestTlogReplica, TestFaceting, TimeZoneUtilsTest, ResponseLogComponentTest, TestCustomStream, UnloadDistributedZkTest, DistributedFacetPivotWhiteBoxTest, TestLFUCache, TestNumericTerms32, TestUseDocValuesAsStored2, TestSubQueryTransformer, TestFieldCacheReopen, TestRandomFlRTGCloud, WrapperMergePolicyFactoryTest, ConfigureRecoveryStrategyTest, MoreLikeThisHandlerTest, TestExpandComponent, TestInitQParser, RegexBytesRefFilterTest, TestRequestForwarding, TestFiltering, HdfsChaosMonkeyNothingIsSafeTest, TestSolrConfigHandler, ResponseHeaderTest, TestBinaryResponseWriter, TestManagedResource, OverseerCollectionConfigSetProcessorTest, DeleteInactiveReplicaTest, TestBulkSchemaAPI, TestMissingGroups, LeaderElectionIntegrationTest, TestLegacyFieldReuse, CacheHeaderTest, V2ApiIntegrationTest, HdfsRecoverLeaseTest, AutoScalingHandlerTest, TestSchemaResource, TestSimDistributedQueue, TestRetrieveFieldsOptimizer, SearchHandlerTest, BlobRepositoryCloudTest, TestManagedSchemaThreadSafety, ConnectionReuseTest, TimeRoutedAliasUpdateProcessorTest, TestRestoreCore, TestHdfsBackupRestoreCore, TestCoreAdminApis, TestScoreJoinQPNoScore, TestUtilizeNode, BasicAuthIntegrationTest, TestOrdValues, TestCoreContainer, TestExactSharedStatsCache, HdfsSyncSliceTest, CustomCollectionTest, InfoHandlerTest, TestFieldCacheVsDocValues, TestEmbeddedSolrServerConstructors, SolrCmdDistributorTest, TestAnalyzedSuggestions, TestUnifiedSolrHighlighter, TestHdfsCloudBackupRestore, CleanupOldIndexTest, BigEndianAscendingWordDeserializerTest, TestSolrConfigHandlerCloud, StatelessScriptUpdateProcessorFactoryTest, SolrSlf4jReporterTest, TestObjectReleaseTracker, TestExecutePlanAction, TestCodecSupport, AtomicUpdatesTest, DistribCursorPagingTest, ClusterStateUpdateTest, TestLeaderElectionWithEmptyReplica, SystemLogListenerTest, TestMacros, TestFreeTextSuggestions, ReturnFieldsTest, TestMultiValuedNumericRangeQuery, TestBadConfig, TestCoreDiscovery, SharedFSAutoReplicaFailoverTest, SuggesterTSTTest, TestSolr4Spatial2, TermVectorComponentTest, TestAtomicUpdateErrorCases, TestBackupRepositoryFactory, TestClusterStateMutator, TestHalfAndHalfDocValues, FileBasedSpellCheckerTest, MergeStrategyTest, SpellCheckComponentTest, TestStressCloudBlindAtomicUpdates, CollectionsAPIAsyncDistributedZkTest, CircularListTest, DataDrivenBlockJoinTest, RecoveryZkTest, LeaderElectionTest, ZkControllerTest, TestRealTimeGet, TestJoin, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestLazyCores, TestPseudoReturnFields, TestUpdate, TestWordDelimiterFilterFactory, DocValuesMultiTest, XsltUpdateRequestHandlerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, RequestHandlersTest, RequiredFieldsTest, LoggingHandlerTest, TestJmxIntegration, BinaryUpdateRequestHandlerTest, CSVRequestHandlerTest, TestQuerySenderListener, AlternateDirectoryTest, CopyFieldTest, TestSolrDeletionPolicy2, MultiTermTest, NumericFieldsTest, TestElisionMultitermQuery, TestSolrCoreProperties, TestPostingsSolrHighlighter, TestPhraseSuggestions, SynonymTokenizerTest, TestLMJelinekMercerSimilarityFactory, ResourceLoaderTest, URLClassifyProcessorTest, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, ClusterStateTest, TestLRUCache, TestUtils, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CursorPagingTest, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, AsyncCallRequestStatusResponseTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CreateCollectionCleanupTest, DeleteNodeTest, DeleteShardTest, DistribJoinFromCollectionTest, HttpPartitionOnCommitTest, LIRRollingUpdatesTest, LeaderInitiatedRecoveryOnShardRestartTest, MissingSegmentRecoveryTest, MoveReplicaTest, RecoveryAfterSoftCommitTest, ReplaceNodeNoTargetTest, RollingRestartTest, TestCloudRecovery, TestConfigSetsAPIExclusivity, TestDeleteCollectionOnDownNodes, TestDownShardTolerantSearch, TestLockTree, TestPrepRecovery, ZkFailoverTest, SimpleCollectionCreateDeleteTest, TestCollectionAPI, TestCollectionsAPIViaSolrCloudCluster, MetricTriggerTest, NodeAddedTriggerTest, TriggerIntegrationTest]
[junit4] Completed [619/774 (3!)] on J2 in 200.19s, 14 tests, 2 failures <<< FAILURES!
[...truncated 44442 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1321
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1321/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=6136, name=jetty-launcher-1393-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063) 3) Thread[id=6195, name=jetty-launcher-1393-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=6136, name=jetty-launcher-1393-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
3) Thread[id=6195, name=jetty-launcher-1393-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
at __randomizedtesting.SeedInfo.seed([E11F9BB19776ECB0]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
at __randomizedtesting.SeedInfo.seed([E11F9BB19776ECB0]:0)
Build Log:
[...truncated 12761 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_E11F9BB19776ECB0-001/init-core-data-001
[junit4] 2> 927247 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=39 numCloses=39
[junit4] 2> 927247 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 927249 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 927251 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 927298 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_E11F9BB19776ECB0-001/tempDir-001
[junit4] 2> 927298 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 927339 INFO (Thread-1131) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 927339 INFO (Thread-1131) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 927371 ERROR (Thread-1131) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 927399 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:36541
[junit4] 2> 927403 INFO (zkConnectionManagerCallback-1396-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 927427 INFO (jetty-launcher-1393-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 927433 INFO (jetty-launcher-1393-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 927451 INFO (jetty-launcher-1393-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 927451 INFO (jetty-launcher-1393-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 927451 INFO (jetty-launcher-1393-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 927459 INFO (jetty-launcher-1393-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19013a9{/solr,null,AVAILABLE}
[junit4] 2> 927484 INFO (jetty-launcher-1393-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@18b89fc{SSL,[ssl, http/1.1]}{127.0.0.1:37105}
[junit4] 2> 927484 INFO (jetty-launcher-1393-thread-1) [ ] o.e.j.s.Server Started @929052ms
[junit4] 2> 927484 INFO (jetty-launcher-1393-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37105}
[junit4] 2> 927484 ERROR (jetty-launcher-1393-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 927484 INFO (jetty-launcher-1393-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 927484 INFO (jetty-launcher-1393-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 927484 INFO (jetty-launcher-1393-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 927484 INFO (jetty-launcher-1393-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T04:57:27.843Z
[junit4] 2> 927515 INFO (jetty-launcher-1393-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 927515 INFO (jetty-launcher-1393-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 927515 INFO (jetty-launcher-1393-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 927527 INFO (jetty-launcher-1393-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b1d1b4{/solr,null,AVAILABLE}
[junit4] 2> 927528 INFO (jetty-launcher-1393-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@119d1d4{SSL,[ssl, http/1.1]}{127.0.0.1:38741}
[junit4] 2> 927528 INFO (jetty-launcher-1393-thread-2) [ ] o.e.j.s.Server Started @929097ms
[junit4] 2> 927528 INFO (jetty-launcher-1393-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38741}
[junit4] 2> 927529 ERROR (jetty-launcher-1393-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 927529 INFO (jetty-launcher-1393-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 927529 INFO (jetty-launcher-1393-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 927529 INFO (jetty-launcher-1393-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 927529 INFO (jetty-launcher-1393-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-09T04:57:27.888Z
[junit4] 2> 927551 INFO (zkConnectionManagerCallback-1400-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 927552 INFO (jetty-launcher-1393-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 927555 INFO (zkConnectionManagerCallback-1398-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 927556 INFO (jetty-launcher-1393-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 927563 INFO (jetty-launcher-1393-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36541/solr
[junit4] 2> 927568 INFO (jetty-launcher-1393-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36541/solr
[junit4] 2> 927571 INFO (zkConnectionManagerCallback-1404-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 927585 INFO (zkConnectionManagerCallback-1408-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 927599 INFO (zkConnectionManagerCallback-1410-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 927611 INFO (zkConnectionManagerCallback-1412-thread-1-processing-n:127.0.0.1:37105_solr) [n:127.0.0.1:37105_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 927722 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 927722 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38741_solr
[junit4] 2> 927723 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.Overseer Overseer (id=72117586225528837-127.0.0.1:38741_solr-n_0000000000) starting
[junit4] 2> 927727 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 927728 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37105_solr
[junit4] 2> 927740 INFO (zkCallback-1409-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 927801 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38741_solr
[junit4] 2> 927804 INFO (zkCallback-1411-thread-2-processing-n:127.0.0.1:37105_solr) [n:127.0.0.1:37105_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 927807 INFO (zkCallback-1409-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 927971 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 927976 WARN (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 927978 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 927983 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 928020 INFO (jetty-launcher-1393-thread-1-EventThread) [n:127.0.0.1:37105_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 928046 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 928047 WARN (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 928055 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 928057 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 928068 INFO (jetty-launcher-1393-thread-2-EventThread) [n:127.0.0.1:38741_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 928084 WARN (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 928175 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37105.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bdc4f0
[junit4] 2> 928192 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37105.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bdc4f0
[junit4] 2> 928192 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37105.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bdc4f0
[junit4] 2> 928194 INFO (jetty-launcher-1393-thread-1) [n:127.0.0.1:37105_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_E11F9BB19776ECB0-001/tempDir-001/node1/.
[junit4] 2> 929152 WARN (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 929209 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38741.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bdc4f0
[junit4] 2> 929271 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38741.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bdc4f0
[junit4] 2> 929271 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38741.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bdc4f0
[junit4] 2> 929273 INFO (jetty-launcher-1393-thread-2) [n:127.0.0.1:38741_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_E11F9BB19776ECB0-001/tempDir-001/node2/.
[junit4] 2> 929340 INFO (zkConnectionManagerCallback-1418-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 929365 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 929477 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1518188249825&s=D5KQ8x7R9cTiru5GdptC6qFbCGY="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:29 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:29 GMT
[junit4] 2> 929478 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 929497 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 929503 INFO (qtp8738800-6086) [n:127.0.0.1:37105_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 929503 INFO (qtp8738800-6086) [n:127.0.0.1:37105_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 929504 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1518188249861&s=gQ1btZvNUnksMkbLl6+7R2Tma1Y="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:29 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:29 GMT
[junit4] 2> 929504 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 929544 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 929546 INFO (qtp8738800-6084) [n:127.0.0.1:37105_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 929547 INFO (qtp8738800-6084) [n:127.0.0.1:37105_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 929548 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1518188249905&s=9O0rED0AXQdVi69KacSvoWhnBM8="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:29 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:29 GMT
[junit4] 2> 929548 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 929578 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 929588 INFO (zkConnectionManagerCallback-1421-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 929979 INFO (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 929981 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 929982 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36541/solr ready
[junit4] 2> 929995 INFO (qtp8738800-6085) [n:127.0.0.1:37105_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 929997 INFO (OverseerThreadFactory-2265-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 930102 INFO (OverseerStateUpdate-72117586225528837-127.0.0.1:38741_solr-n_0000000000) [n:127.0.0.1:38741_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38741/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 930427 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 930432 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 930536 INFO (zkCallback-1409-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 930539 INFO (zkCallback-1409-thread-2-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 931538 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 931615 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 931793 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 931848 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 931849 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38741.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bdc4f0
[junit4] 2> 931849 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 931849 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_E11F9BB19776ECB0-001/tempDir-001/node2/forwardingCollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_E11F9BB19776ECB0-001/tempDir-001/node2/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 931854 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=32.12890625, floorSegmentMB=0.5537109375, forceMergeDeletesPctAllowed=10.444842347848795, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 931993 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 931993 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 931996 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 931996 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 931999 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=12, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6260328477351511]
[junit4] 2> 931999 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@b253e[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 932002 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 932475 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 932585 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 932585 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 932586 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 932586 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 932586 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 932586 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 932586 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 932586 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 932587 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 932587 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 932588 INFO (searcherExecutor-2270-thread-1-processing-n:127.0.0.1:38741_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@b253e[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 932592 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1591898016790347776
[junit4] 2> 932598 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 932598 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 932598 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38741/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 932598 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 932599 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:38741/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 932599 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 932602 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38741/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 932605 INFO (zkCallback-1409-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 932605 INFO (zkCallback-1409-thread-2-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 932653 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 932655 INFO (qtp10648346-6094) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2228
[junit4] 2> 932658 WARN (httpShardExecutor-2257-thread-1-processing-n:127.0.0.1:38741_solr [https:////127.0.0.1:38741//solr] https:////127.0.0.1:38741//solr) [n:127.0.0.1:38741_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1518188250785&s=qtrq2j/zzB+o9ll5BvoAFcJTF3M="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:30 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:30 GMT
[junit4] 2> 932664 INFO (qtp8738800-6085) [n:127.0.0.1:37105_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 932759 INFO (zkCallback-1409-thread-3-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 932759 INFO (zkCallback-1409-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 933665 INFO (qtp8738800-6085) [n:127.0.0.1:37105_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3670
[junit4] 2> 933666 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1518188250353&s=wtZdtJKUJAAlGnCpw0Hl0cXcVEA="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:30 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:30 GMT
[junit4] 2> 933666 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 933666 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 933691 INFO (qtp8738800-6080) [n:127.0.0.1:37105_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 933700 INFO (qtp10648346-6095) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 933701 WARN (qtp8738800-6080) [n:127.0.0.1:37105_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1518188254057&s=9e56gBVPmKjHkAgFfRGM0Bn1jw0="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:34 GMT
[junit4] 2> 933702 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1518188254049&s=eeSATY0M7GwBo+6sR44N/vy+UHM="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:34 GMT
[junit4] 2> 933702 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1518188254057&s=9e56gBVPmKjHkAgFfRGM0Bn1jw0="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:34 GMT
[junit4] 2> 933711 INFO (qtp10648346-6089) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 933712 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1518188254070&s=ZG3o5z82zCe+1+rU+ifCiA4Dzh4="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:34 GMT
[junit4] 2> 933713 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 933737 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 933748 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1518188254098&s=W4SdvwNjSFTWKbRjg5WwUjIapwE="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:34 GMT
[junit4] 2> 933748 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 933769 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 944189 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]-SendThread(127.0.0.1:36541)) [ ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 10523ms for sessionid 0x10036900508000b
[junit4] 2> 944190 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10036900508000b, likely client has closed socket
[junit4] 2> 944190 WARN (jetty-launcher-1393-thread-2-SendThread(127.0.0.1:36541)) [n:127.0.0.1:38741_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15008ms for sessionid 0x100369005080008
[junit4] 2> 944190 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15009ms for sessionid 0x100369005080007
[junit4] 2> 944194 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1518188254129&s=O7Svj/qU62wUHnqaVYGIpHotnhM="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:34 GMT
[junit4] 2> 944194 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100369005080008, likely client has closed socket
[junit4] 2> 944195 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 944195 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100369005080007, likely client has closed socket
[junit4] 2> 944199 INFO (OverseerCollectionConfigSetProcessor-72117586225528837-127.0.0.1:38741_solr-n_0000000000) [n:127.0.0.1:38741_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 944245 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 944280 WARN (qtp8738800-6086) [n:127.0.0.1:37105_solr ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ‘bar’: no such user
[junit4] 2> id: ‘bar’: no such user
[junit4] 2>
[junit4] 2> 944288 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1518188264606&s=s2GplWhxFTdkwHna6e0UfcOuee8="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:44 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:44 GMT
[junit4] 2> 944288 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 944299 INFO (jetty-launcher-1393-thread-1-EventThread) [n:127.0.0.1:37105_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 944312 WARN (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@ded554 name: ZooKeeperConnection Watcher:127.0.0.1:36541/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 944312 WARN (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 944332 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 949355 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100369005080007 has expired
[junit4] 2> 949355 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1518188264693&s=OpUmJ0OZUJMacOvS9m1ro+Ywy8Y="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:44 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:44 GMT
[junit4] 2> 949355 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 949356 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[E11F9BB19776ECB0]-SendThread(127.0.0.1:36541)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x10036900508000b has expired
[junit4] 2> 949356 WARN (jetty-launcher-1393-thread-2-SendThread(127.0.0.1:36541)) [n:127.0.0.1:38741_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100369005080008 has expired
[junit4] 2> 949359 WARN (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@ded554 name: ZooKeeperConnection Watcher:127.0.0.1:36541/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 949359 WARN (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 949369 WARN (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 949376 INFO (zkConnectionManagerCallback-1424-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 949376 INFO (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 949382 INFO (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 949382 INFO (zkConnectionManagerCallback-1424-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient Connected:true
[junit4] 2> 949394 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 949403 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1518188269754&s=Q7orgT5NBUyPtwD+GEnrtkea1kw="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:49 GMT
[junit4] 2> 949403 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 949423 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 949433 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1518188269785&s=21uDQAtmYSr1ECGUcN7v7sxdgis="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:49 GMT
[junit4] 2> 949433 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 949454 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 949493 INFO (qtp8738800-6086) [n:127.0.0.1:37105_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 949494 INFO (qtp8738800-6086) [n:127.0.0.1:37105_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 949495 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[E11F9BB19776ECB0]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1518188269817&s=KmOnzkyJ8m7b6MgYeN//BeoAcEQ="; Path=/; Domain=127.0.0.1; Expires= , 09- -2018 14:57:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 09- -2018 14:57:49 GMT
[junit4] 2> 949495 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 949515 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 949516 INFO (qtp8738800-6080) [n:127.0.0.1:37105_solr ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:289)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection$3.succeeded(SslConnection.java:149)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 949517 WARN (qtp8738800-6080) [n:127.0.0.1:37105_solr ] o.e.j.s.HttpChannel /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:455)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:289)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection$3.succeeded(SslConnection.java:149)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
[junit4] 2> ... 34 more
[junit4] 2> 949524 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[E11F9BB19776ECB0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 949533 INFO (jetty-closer-1394-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@119d1d4{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 949533 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=23486946
[junit4] 2> 949533 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 949533 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c7f5dd: rootName = solr_38741, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1f3e6a9
[junit4] 2> 949535 INFO (jetty-closer-1394-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@18b89fc{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 949535 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1692288
[junit4] 2> 949535 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 949535 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d1a068: rootName = solr_37105, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@114bcdf
[junit4] 2> 949547 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 949549 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18b7202: rootName = solr_37105, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@fe3329
[junit4] 2> 949553 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 949553 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1de42c9: rootName = solr_38741, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@fe3329
[junit4] 2> 949557 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 949557 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@67d72b: rootName = solr_37105, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@114ed0f
[junit4] 2> 949558 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37105_solr
[junit4] 2> 949559 INFO (zkCallback-1409-thread-3-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 949559 INFO (zkCallback-1411-thread-1-processing-n:127.0.0.1:37105_solr) [n:127.0.0.1:37105_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 949559 INFO (jetty-closer-1394-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 949569 ERROR (Thread[Thread-1148,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:37105_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 949570 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 949570 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17217e4: rootName = solr_38741, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@114ed0f
[junit4] 2> 949571 INFO (jetty-closer-1394-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@19013a9{/solr,null,UNAVAILABLE}
[junit4] 2> 949571 INFO (jetty-closer-1394-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 949576 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38741_solr
[junit4] 2> 949577 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 949577 INFO (zkCallback-1409-thread-3-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 949577 INFO (zkCallback-1409-thread-1-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [0])
[junit4] 2> 949577 INFO (zkCallback-1409-thread-2-processing-n:127.0.0.1:38741_solr) [n:127.0.0.1:38741_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [0])
[junit4] 2> 949581 INFO (coreCloseExecutor-2276-thread-1) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@19859d4
[junit4] 2> 949581 INFO (coreCloseExecutor-2276-thread-1) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=26761684
[junit4] 2> 949582 INFO (coreCloseExecutor-2276-thread-1) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1c11143: rootName = solr_38741, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@848ed0
[junit4] 2> 949606 INFO (coreCloseExecutor-2276-thread-1) [n:127.0.0.1:38741_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=26761684
[junit4] 2> 949609 INFO (jetty-closer-1394-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72117586225528837-127.0.0.1:38741_solr-n_0000000000) closing
[junit4] 2> 949609 INFO (OverseerStateUpdate-72117586225528837-127.0.0.1:38741_solr-n_0000000000) [n:127.0.0.1:38741_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38741_solr
[junit4] 2> 949609 WARN (OverseerAutoScalingTriggerThread-72117586225528837-127.0.0.1:38741_solr-n_0000000000) [n:127.0.0.1:38741_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 949611 ERROR (Thread[Thread-1151,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:38741_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 949612 INFO (jetty-closer-1394-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@b1d1b4{/solr,null,UNAVAILABLE}
[junit4] 2> 949612 INFO (jetty-closer-1394-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 949612 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 949613 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36541 36541
[junit4] 2> 955264 INFO (Thread-1131) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36541 36541
[junit4] 2> 955264 WARN (Thread-1131) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/collections/forwardingCollection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/forwardingCollection/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 955297 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[E11F9BB19776ECB0]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 09, 2018 4:57:55 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 974344 ERROR (jetty-launcher-1393-thread-1-EventThread) [n:127.0.0.1:37105_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.IllegalStateException: Client is not started
[junit4] 2> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
[junit4] 2> at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> 974345 WARN (jetty-launcher-1393-thread-1-EventThread) [n:127.0.0.1:37105_solr ] o.a.c.ConnectionState Session expired event received
[junit4] 2> 974347 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> Feb 09, 2018 4:58:15 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] 2> 1) Thread[id=6136, name=jetty-launcher-1393-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> 2) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> 3) Thread[id=6195, name=jetty-launcher-1393-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] 2> Feb 09, 2018 4:58:15 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=6136, name=jetty-launcher-1393-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 2) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 3) Thread[id=6195, name=jetty-launcher-1393-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 975401 ERROR (jetty-launcher-1393-thread-2-EventThread) [n:127.0.0.1:38741_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> 975401 ERROR (jetty-launcher-1393-thread-1-EventThread) [n:127.0.0.1:37105_solr ] o.a.z.ClientCnxn Event thread exiting due to interruption
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] 2> 975401 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.c.StaticHostProvider Unexpected exception
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> 975401 WARN (jetty-launcher-1393-thread-2-EventThread) [n:127.0.0.1:38741_solr ] o.a.c.ConnectionState Session expired event received
[junit4] 2> 975402 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 975402 WARN (jetty-launcher-1393-thread-2-SendThread(127.0.0.1:36541)) [n:127.0.0.1:38741_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected erro
[...truncated too long message...]
)
[junit4] 2> 977408 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 977604 WARN (jetty-launcher-1393-thread-2-SendThread(127.0.0.1:36541)) [n:127.0.0.1:38741_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 977907 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.c.StaticHostProvider Unexpected exception
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> 977908 WARN (jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541)) [n:127.0.0.1:37105_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> Feb 09, 2018 4:58:18 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=412, maxMBSortInHeap=6.1990064534628635, sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=Etc/GMT-8
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=4,free=300473160,total=517005312
[junit4] 2> NOTE: All tests run in this JVM: [TestPerFieldSimilarityWithDefaultOverride, CSVRequestHandlerTest, StatsReloadRaceTest, TestConfigSetsAPIExclusivity, LeaderFailoverAfterPartitionTest, ClassificationUpdateProcessorIntegrationTest, TestUseDocValuesAsStored, TestSweetSpotSimilarityFactory, TestMaxTokenLenTokenizer, CdcrReplicationDistributedZkTest, SolrCloudExampleTest, TestBulkSchemaConcurrent, TestFieldCache, ScriptEngineTest, CdcrVersionReplicationTest, BadCopyFieldTest, TestMinMaxOnMultiValuedField, TestSolr4Spatial, JsonLoaderTest, SOLR749Test, TestConfigSetImmutable, TestDistribIDF, TestFileDictionaryLookup, TestPayloadScoreQParserPlugin, PrimitiveFieldTypeTest, TestStressRecovery, TestSolrCLIRunExample, TestCursorMarkWithoutUniqueKey, TestRTGBase, TestSolrJ, TestSolrFieldCacheBean, SimplePostToolTest, TestDeleteCollectionOnDownNodes, DocExpirationUpdateProcessorFactoryTest, SmileWriterTest, FieldMutatingUpdateProcessorTest, DirectUpdateHandlerOptimizeTest, TestConfigsApi, TestStressVersions, TestImpersonationWithHadoopAuth, SuggesterFSTTest, PrimUtilsTest, TestSearchPerf, CreateRoutedAliasTest, MultiThreadedOCPTest, ZkControllerTest, HLLSerializationTest, TestSimpleTrackingShardHandler, TestSegmentSorting, DistributedDebugComponentTest, OverriddenZkACLAndCredentialsProvidersTest, AnalyticsQueryTest, BJQParserTest, SearchRateTriggerTest, TestJsonRequest, TestLegacyFieldCache, DocValuesNotIndexedTest, MetricTriggerTest, ChaosMonkeySafeLeaderTest, TestJettySolrRunner, PropertiesRequestHandlerTest, UninvertDocValuesMergePolicyTest, TestChildDocTransformer, TestSolrIndexConfig, ResourceLoaderTest, BasicFunctionalityTest, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=E11F9BB19776ECB0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=Etc/GMT-8 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=6136, name=jetty-launcher-1393-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > 2) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > 3) Thread[id=6195, name=jetty-launcher-1393-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] > at __randomizedtesting.SeedInfo.seed([E11F9BB19776ECB0]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=6194, name=jetty-launcher-1393-thread-1-SendThread(127.0.0.1:36541), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > at __randomizedtesting.SeedInfo.seed([E11F9BB19776ECB0]:0)
[junit4] Completed [191/774 (1!)] on J1 in 51.18s, 12 tests, 2 errors <<< FAILURES!
[...truncated 45816 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1320
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1320/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([37808BC0FD5F5223:5A7C2F3D4717AD24]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:265)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13 lines...]
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:862)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1129)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1160)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1203)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1727)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Broken pipe (Write failed)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:634)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:860)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Broken pipe (Write failed)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:135)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:632)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Broken pipe (Write failed)
at org.eclipse.jgit.transport.BasePackFetchConnection.doFetch(BasePackFetchConnection.java:377)
at org.eclipse.jgit.transport.BasePackFetchConnection.fetch(BasePackFetchConnection.java:308)
at org.eclipse.jgit.transport.BasePackFetchConnection.fetch(BasePackFetchConnection.java:298)
at org.eclipse.jgit.transport.FetchProcess.fetchObjects(FetchProcess.java:245)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:161)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1201)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:128)
... 13 more
Caused by: java.net.SocketException: Broken pipe (Write failed)
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at org.eclipse.jgit.transport.PacketLineOut.flush(PacketLineOut.java:180)
at org.eclipse.jgit.transport.PacketLineOut.end(PacketLineOut.java:167)
at org.eclipse.jgit.transport.BasePackFetchConnection.negotiate(BasePackFetchConnection.java:573)
at org.eclipse.jgit.transport.BasePackFetchConnection.doFetch(BasePackFetchConnection.java:363)
... 20 more
ERROR: Error fetching remote repo 'origin'
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
Checking out Revision 8a370fa900512a48aa460430cb15c92ed3733020 (refs/remotes/origin/branch_7x)
Commit message: "LUCENE-7966: Add test for legacy version of StringHelper"
No emails were triggered.
[description-setter] Description set: Java: 32bit/jdk1.8.0_162 -server -XX:+UseConcMarkSweepGC
[Lucene-Solr-7.x-Linux] $ /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/bin/ant "-Dargs=-server -XX:+UseConcMarkSweepGC" jenkins-hourly
Buildfile: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml
jenkins-hourly:
-print-java-info:
[java-info] java version "1.8.0_162"
[java-info] Java(TM) SE Runtime Environment (1.8.0_162-b12, Oracle Corporation)
[java-info] Java HotSpot(TM) Server VM (25.162-b12, Oracle Corporation)
[java-info] Test args: [-server -XX:+UseConcMarkSweepGC]
clean:
clean:
clean:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.codehaus.groovy#groovy-all;2.4.12 in public
[ivy:cachepath] :: resolution report :: resolve 124ms :: artifacts dl 1ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 1 | 0 | 0 | 0 || 1 | 0 |
---------------------------------------------------------------------
-test-with-heapdumps-enabled:
[echo] Java HotSpot(TM) Server VM: Enabling heap dumps on OutOfMemoryError to dir '/home/jenkins/workspace/Lucene-Solr-7.x-Linux/heapdumps'.
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/heapdumps
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve-groovy:
test:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
-clover.load:
resolve-groovy:
-init-totals:
test-core:
-clover.disable:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
-clover.load:
-clover.classpath:
-clover.setup:
clover:
-check-git-state:
-git-cleanroot:
-copy-git-state:
[copy] Copying 1 file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build
git-autoclean:
resolve:
init:
compile-core:
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java
[javac] Compiling 827 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/graph/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/document/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/bkd/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/compressing/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene60/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/index/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/fst/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/tokenattributes/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/search/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene62/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/packed/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/mutable/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene70/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/perfield/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/standard/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/store/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/blocktree/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/search/spans/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/search/similarities/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/automaton/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene50/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/geo/package-info.class
[copy] Copying 3 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java
compile-test-framework:
-check-git-state:
-git-cleanroot:
-copy-git-state:
git-autoclean:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
init:
compile-lucene-core:
-check-git-state:
-git-cleanroot:
-copy-git-state:
git-autoclean:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
init:
-clover.disable:
-clover.load:
-clover.classpath:
-clover.setup:
clover:
compile-core:
compile-codecs:
-check-git-state:
-git-cleanroot:
-copy-git-state:
git-autoclean:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
common.init:
compile-lucene-core:
init:
-clover.disable:
-clover.load:
-clover.classpath:
-clover.setup:
clover:
compile-core:
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java
[javac] Compiling 67 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/bloom/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/memory/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/simpletext/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/blockterms/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/blocktreeords/package-info.class
[copy] Copying 3 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java
-clover.disable:
-clover.load:
-clover.classpath:
-clover.setup:
clover:
common.compile-core:
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java
[javac] Compiling 188 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/asserting/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/ramonly/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/mockfile/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/cheapbastard/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/mockrandom/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/cranky/package-info.class
[javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/compressing/dummy/package-info.class
[copy] Copying 4 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java
compile-core:
compile-test:
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/test
[javac] Compiling 468 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/test
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[copy] Copying 3 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/test
-mrjar-classes-uptodate:
resolve-groovy:
patch-mrjar-classes:
[groovy] Remapped: org/apache/lucene/analysis/tokenattributes/CharTermAttributeImpl
[groovy] Remapped: org/apache/lucene/codecs/compressing/LZ4
[groovy] Remapped: org/apache/lucene/document/BinaryPoint$2
[groovy] Remapped: org/apache/lucene/document/DoubleRange
[groovy] Remapped: org/apache/lucene/document/FloatRange
[groovy] Remapped: org/apache/lucene/document/IntRange
[groovy] Remapped: org/apache/lucene/document/LongRange
[groovy] Remapped: org/apache/lucene/index/BitsSlice
[groovy] Remapped: org/apache/lucene/index/CodecReader
[groovy] Remapped: org/apache/lucene/index/MergeReaderWrapper
[groovy] Remapped: org/apache/lucene/search/BooleanScorer$TailPriorityQueue
[groovy] Remapped: org/apache/lucene/util/BytesRef
[groovy] Remapped: org/apache/lucene/util/BytesRefArray
[groovy] Remapped: org/apache/lucene/util/CharsRef$UTF16SortedAsUTF8Comparator
[groovy] Remapped: org/apache/lucene/util/CharsRef
[groovy] Remapped: org/apache/lucene/util/IntsRef
[groovy] Remapped: org/apache/lucene/util/LongsRef
[groovy] Remapped: org/apache/lucene/util/StringHelper
[groovy] Remapped: org/apache/lucene/util/automaton/Automaton$Builder
[groovy] Remapped: org/apache/lucene/util/automaton/Automaton
[groovy] Remapped 20 class files for Java 9 to: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java9
[touch] Creating /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/patch-mrjar.stamp
install-junit4-taskdef:
validate:
-init-totals:
-test:
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test
[loadresource] Do not set property tests.explicitclass as its length is 0.
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/.caches/test-stats/core
[junit4] <JUnit4> says olá! Master seed: DC21F2B5D7F60FF
[junit4] Executing 461 suites with 3 JVMs.
[junit4]
[junit4] Started J0 PID(4150@localhost).
[junit4] Started J2 PID(4149@localhost).
[junit4] Started J1 PID(4151@localhost).
[junit4] Suite: org.apache.lucene.search.spans.TestSpanCollection
[junit4] Completed [1/461] on J2 in 1.03s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestManyFields
[junit4] Completed [2/461] on J1 in 2.79s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestIndexSearcher
[junit4] Completed [3/461] on J1 in 0.46s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestDirectory
[junit4] IGNOR/A 0.01s J1 | TestDirectory.testListAll
[junit4] > Assumption #1: this test does not expect extra files
[junit4] Completed [4/461] on J1 in 0.29s, 4 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestCustomSearcherSort
[junit4] Completed [5/461] on J1 in 1.61s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestPointValues
[junit4] Completed [6/461] on J2 in 10.56s, 32 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTermScorer
[junit4] Completed [7/461] on J2 in 0.20s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDuelingCodecs
[junit4] Completed [8/461] on J1 in 14.71s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BDocs
[junit4] IGNOR/A 0.00s J1 | Test2BDocs.test2BDocs
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=Takes ~30min))
[junit4] Completed [9/461] on J1 in 0.01s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestIntRangeFieldQueries
[junit4] IGNOR/A 0.01s J2 | TestIntRangeFieldQueries.testRandomBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [10/461] on J2 in 9.15s, 5 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.similarities.TestSimilarity2
[junit4] Completed [11/461] on J2 in 0.61s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50StoredFieldsFormat
[junit4] IGNOR/A 0.00s J1 | TestLucene50StoredFieldsFormat.testBigDocuments
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [12/461] on J1 in 3.57s, 17 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.FiniteStringsIteratorTest
[junit4] Completed [13/461] on J1 in 2.97s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestUsageTrackingFilterCachingPolicy
[junit4] Completed [14/461] on J1 in 0.05s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestElevationComparator
[junit4] Completed [15/461] on J1 in 0.03s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestLongBitSet
[junit4] IGNOR/A 0.00s J1 | TestLongBitSet.testHugeCapacity
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [16/461] on J1 in 0.37s, 11 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSumDocFreq
[junit4] Completed [17/461] on J1 in 0.10s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBooleanQuery
[junit4] Completed [18/461] on J1 in 0.51s, 22 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTermVectorsReader
[junit4] Completed [19/461] on J1 in 0.23s, 13 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDoc
[junit4] Completed [20/461] on J1 in 0.13s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestFutureObjects
[junit4] Completed [21/461] on J1 in 0.07s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterThreadsToSegments
[junit4] Completed [22/461] on J0 in 29.11s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.packed.TestPackedInts
[junit4] IGNOR/A 0.00s J2 | TestPackedInts.testBlockReaderOverflow
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [23/461] on J2 in 11.11s, 28 tests, 3 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSegmentTermDocs
[junit4] Completed [24/461] on J2 in 0.92s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.TestAssertions
[junit4] Completed [25/461] on J2 in 0.04s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestInPlaceMergeSorter
[junit4] Completed [26/461] on J2 in 0.18s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSwappedIndexFiles
[junit4] Completed [27/461] on J2 in 0.24s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestPayloadsOnVectors
[junit4] Completed [28/461] on J2 in 0.11s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestExceedMaxTermLength
[junit4] Completed [29/461] on J2 in 0.14s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanNotQuery
[junit4] Completed [30/461] on J2 in 0.04s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.MultiCollectorTest
[junit4] Completed [31/461] on J2 in 0.10s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestDoubleValuesSource
[junit4] Completed [32/461] on J0 in 6.52s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSegmentReader
[junit4] Completed [33/461] on J2 in 1.23s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestFieldMaskingSpanQuery
[junit4] IGNOR/A 0.01s J0 | TestFieldMaskingSpanQuery.testSpans2
[junit4] > Assumption #1: Broken scoring: LUCENE-3723
[junit4] IGNOR/A 0.00s J0 | TestFieldMaskingSpanQuery.testSimple2
[junit4] > Assumption #1: Broken scoring: LUCENE-3723
[junit4] Completed [35/461] on J0 in 0.54s, 11 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMultiCollector
[junit4] Completed [36/461] on J2 in 0.71s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTermRangeQuery
[junit4] Completed [37/461] on J2 in 0.32s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSegmentInfos
[junit4] Completed [38/461] on J2 in 0.07s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTwoPhaseCommitTool
[junit4] Completed [39/461] on J2 in 0.06s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestByteBlockPool
[junit4] Completed [40/461] on J2 in 0.28s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestCharTermAttributeImpl
[junit4] Completed [41/461] on J2 in 0.64s, 13 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterCommit
[junit4] IGNOR/A 0.00s J2 | TestIndexWriterCommit.testCommitOnCloseDiskUsage
[junit4] > Assumption #1: This test cannot run with Memory codec
[junit4] Completed [42/461] on J2 in 1.64s, 14 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBooleanScorer
[junit4] Completed [43/461] on J0 in 6.18s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestExitableDirectoryReader
[junit4] Completed [44/461] on J0 in 0.01s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BTerms
[junit4] IGNOR/A 0.00s J0 | Test2BTerms.test2BTerms
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=very slow, use 5g minimum heap))
[junit4] Completed [45/461] on J0 in 0.02s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene70.TestIndexedDISI
[junit4] Completed [46/461] on J0 in 3.68s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNumericDocValuesUpdates
[junit4] Completed [47/461] on J2 in 24.44s, 32 tests
[junit4]
[junit4] Suite: org.apache.lucene.document.TestBinaryDocument
[junit4] Completed [48/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestTimSorter
[junit4] Completed [49/461] on J2 in 0.05s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestUpgradeIndexMergePolicy
[junit4] Completed [50/461] on J2 in 0.03s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.document.TestField
[junit4] Completed [51/461] on J2 in 0.05s, 23 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.TestCompiledAutomaton
[junit4] Completed [52/461] on J2 in 0.42s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.mutable.TestMutableValues
[junit4] Completed [53/461] on J2 in 0.01s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat
[junit4] Completed [54/461] on J2 in 4.90s, 27 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.similarities.TestClassicSimilarity
[junit4] Completed [55/461] on J2 in 0.08s, 12 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterMergePolicy
[junit4] Completed [56/461] on J2 in 1.65s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestTimSorterWorstCase
[junit4] Completed [57/461] on J0 in 25.48s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestLongValuesSource
[junit4] Completed [58/461] on J2 in 0.98s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestQueryRescorer
[junit4] Completed [59/461] on J2 in 0.76s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.TestRegExp
[junit4] Completed [60/461] on J2 in 0.07s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexTooManyDocs
[junit4] Completed [61/461] on J2 in 0.59s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSimpleSearchEquivalence
[junit4] Completed [62/461] on J0 in 2.03s, 17 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestConstantScoreQuery
[junit4] Completed [63/461] on J0 in 0.07s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestFutureArrays
[junit4] Completed [64/461] on J0 in 0.13s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestNotDocIdSet
[junit4] Completed [65/461] on J2 in 1.01s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSubScorerFreqs
[junit4] Completed [66/461] on J2 in 0.10s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSnapshotDeletionPolicy
[junit4] Completed [67/461] on J0 in 1.43s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTopDocsMerge
[junit4] Completed [68/461] on J2 in 1.92s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestNeedsScores
[junit4] Completed [69/461] on J2 in 0.11s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.similarities.TestAxiomaticSimilarity
[junit4] Completed [70/461] on J2 in 0.05s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestSparseFixedBitSet
[junit4] Completed [71/461] on J2 in 5.19s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.compressing.TestHighCompressionMode
[junit4] Completed [72/461] on J2 in 1.38s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpansEnum
[junit4] Completed [73/461] on J2 in 0.20s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestConsistentFieldNumbers
[junit4] Completed [74/461] on J2 in 1.50s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSearchWithThreads
[junit4] Completed [75/461] on J2 in 5.93s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBoolean2
[junit4] Completed [76/461] on J0 in 20.62s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNRTThreads
[junit4] Completed [77/461] on J2 in 9.18s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestDateSort
[junit4] Completed [78/461] on J2 in 0.02s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestStressIndexing
[junit4] Completed [79/461] on J0 in 4.63s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocValuesIndexing
[junit4] Completed [80/461] on J0 in 0.60s, 34 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDirectoryReader
[junit4] Completed [81/461] on J2 in 0.83s, 24 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestEarlyTermination
[junit4] Completed [82/461] on J2 in 0.10s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestBytesRefArray
[junit4] Completed [83/461] on J0 in 0.27s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFieldsReader
[junit4] Completed [84/461] on J2 in 0.40s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestRollingUpdates
[junit4] Completed [85/461] on J2 in 1.37s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestBufferedIndexInput
[junit4] Completed [86/461] on J2 in 0.45s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBooleanRewrites
[junit4] Completed [87/461] on J2 in 0.49s, 12 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestVersion
[junit4] Completed [88/461] on J2 in 0.10s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNRTReaderWithThreads
[junit4] Completed [89/461] on J2 in 1.67s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestQueryBuilder
[junit4] Completed [90/461] on J2 in 0.09s, 23 tests
[junit4]
[junit4] HEARTBEAT J1 PID(4151@localhost): 2018-02-09T00:02:26, stalled for 69.5s at: TestLucene70DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue
[junit4] Suite: org.apache.lucene.codecs.perfield.TestPerFieldPostingsFormat
[junit4] IGNOR/A 0.00s J0 | TestPerFieldPostingsFormat.testMergeStability
[junit4] > Assumption #1: The MockRandom PF randomizes content on the fly, so we can't check it
[junit4] IGNOR/A 0.01s J0 | TestPerFieldPostingsFormat.testPostingsEnumReuse
[junit4] > Assumption #1: The MockRandom PF randomizes content on the fly, so we can't check it
[junit4] Completed [91/461] on J0 in 8.91s, 25 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanOrQuery
[junit4] Completed [92/461] on J0 in 0.06s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestCrashCausesCorruptIndex
[junit4] Completed [93/461] on J0 in 0.06s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNewestSegment
[junit4] Completed [94/461] on J0 in 0.06s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMultiPhraseQuery
[junit4] Completed [95/461] on J0 in 0.26s, 16 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestBagOfPostings
[junit4] Completed [96/461] on J2 in 11.14s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMultiLevelSkipList
[junit4] Completed [97/461] on J2 in 0.14s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BSortedDocValuesOrds
[junit4] IGNOR/A 0.00s J2 | Test2BSortedDocValuesOrds.test2BOrds
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=Takes ~ 6 hours if the heap is 5gb))
[junit4] Completed [98/461] on J2 in 0.02s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterReader
[junit4] IGNOR/A 0.00s J2 | TestIndexWriterReader.testDuringAddIndexes
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [99/461] on J2 in 6.04s, 23 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestConjunctions
[junit4] Completed [100/461] on J2 in 0.02s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestNativeFSLockFactory
[junit4] Completed [101/461] on J2 in 6.26s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50TermVectorsFormat
[junit4] Completed [102/461] on J0 in 18.70s, 17 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMultiThreadTermVectors
[junit4] Completed [103/461] on J0 in 2.04s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestUnicodeUtil
[junit4] Completed [104/461] on J0 in 0.50s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestPostingsOffsets
[junit4] Completed [105/461] on J0 in 1.04s, 13 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTermContext
[junit4] Completed [106/461] on J0 in 0.04s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.geo.TestPolygon2D
[junit4] Completed [107/461] on J2 in 6.80s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestRollingBuffer
[junit4] Completed [108/461] on J2 in 0.34s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMultiFields
[junit4] Completed [109/461] on J2 in 0.73s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestFloatRangeFieldQueries
[junit4] IGNOR/A 0.00s J2 | TestFloatRangeFieldQueries.testRandomBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [110/461] on J2 in 4.06s, 5 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestCharacterUtils
[junit4] Completed [111/461] on J2 in 0.01s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestCharsRef
[junit4] Completed [112/461] on J2 in 0.03s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterNRTIsCurrent
[junit4] Completed [113/461] on J0 in 15.27s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterForceMerge
[junit4] Completed [114/461] on J0 in 1.00s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterDeleteByQuery
[junit4] Completed [115/461] on J0 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterConfig
[junit4] Completed [116/461] on J0 in 0.08s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSearchAfter
[junit4] Completed [117/461] on J0 in 0.35s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestIndexOrDocValuesQuery
[junit4] Completed [118/461] on J0 in 0.11s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestLogMergePolicy
[junit4] Completed [119/461] on J0 in 0.08s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocsWithFieldSet
[junit4] Completed [120/461] on J0 in 0.03s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestForceMergeForever
[junit4] Completed [121/461] on J0 in 0.38s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSimpleExplanations
[junit4] Completed [122/461] on J0 in 0.52s, 70 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocIDMerger
[junit4] Completed [123/461] on J0 in 0.03s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestFieldValueQuery
[junit4] Completed [124/461] on J0 in 2.08s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.TestDeterminizeLexicon
[junit4] Completed [125/461] on J0 in 2.51s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMergePolicyWrapper
[junit4] Completed [126/461] on J0 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs
[junit4] Completed [127/461] on J2 in 14.23s, 70 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFieldReuse
[junit4] Completed [128/461] on J2 in 0.03s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterOnDiskFull
[junit4] IGNOR/A 0.00s J2 | TestIndexWriterOnDiskFull.testAddIndexOnDiskFull
[junit4] > Assumption #1: This test cannot run with Memory codec
[junit4] Completed [129/461] on J2 in 0.18s, 4 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestAutomatonQuery
[junit4] Completed [130/461] on J0 in 1.58s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTermVectorsWriter
[junit4] Completed [131/461] on J0 in 0.13s, 15 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.FuzzyTermOnShortTermsTest
[junit4] Completed [132/461] on J0 in 0.05s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexInput
[junit4] Completed [133/461] on J0 in 0.89s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestArrayUtil
[junit4] Completed [134/461] on J2 in 3.37s, 13 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTerms
[junit4] Completed [135/461] on J2 in 0.06s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSortedSetSelector
[junit4] Completed [136/461] on J2 in 0.10s, 15 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestSentinelIntSet
[junit4] Completed [137/461] on J2 in 0.07s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestRamUsageEstimator
[junit4] IGNOR/A 0.00s J2 | TestRamUsageEstimator.testPrintValues
[junit4] > Assumption #1: Specify -Dtests.verbose=true to print constants of RamUsageEstimator.
[junit4] IGNOR/A 0.00s J2 | TestRamUsageEstimator.testHotspotBean
[junit4] > Assumption #1: testHotspotBean only works on 64bit JVMs.
[junit4] Completed [138/461] on J2 in 0.01s, 5 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFlushByRamOrCountsPolicy
[junit4] Completed [139/461] on J0 in 1.71s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexableField
[junit4] Completed [140/461] on J0 in 0.30s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIsCurrent
[junit4] Completed [141/461] on J0 in 0.05s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestCharArrayMap
[junit4] Completed [142/461] on J0 in 0.16s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.bkd.TestMutablePointsReaderUtils
[junit4] Completed [143/461] on J0 in 1.48s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFilterCodecReader
[junit4] Completed [144/461] on J0 in 0.03s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.geo.TestGeoUtils
[junit4] Completed [145/461] on J0 in 10.32s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSortRescorer
[junit4] Completed [146/461] on J0 in 0.21s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BPoints
[junit4] IGNOR/A 0.00s J0 | Test2BPoints.test1D
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=takes at least 4 hours and consumes many GB of temp disk space))
[junit4] IGNOR/A 0.00s J0 | Test2BPoints.test2D
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=takes at least 4 hours and consumes many GB of temp disk space))
[junit4] Completed [147/461] on J0 in 0.00s, 2 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.similarities.TestBM25Similarity
[junit4] Completed [148/461] on J0 in 0.03s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriter
[junit4] Completed [149/461] on J0 in 6.10s, 76 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBoostQuery
[junit4] Completed [150/461] on J0 in 0.03s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestSloppyMath
[junit4] Completed [151/461] on J0 in 1.40s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.fst.TestBytesStore
[junit4] Completed [152/461] on J0 in 0.60s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocsAndPositions
[junit4] Completed [153/461] on J0 in 0.32s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSortedSetSortField
[junit4] Completed [154/461] on J0 in 0.02s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestStringHelper
[junit4] Completed [155/461] on J0 in 0.03s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestOneMergeWrappingMergePolicy
[junit4] Completed [156/461] on J0 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocumentWriter
[junit4] Completed [157/461] on J0 in 0.14s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBlendedTermQuery
[junit4] Completed [158/461] on J0 in 0.04s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
[junit4] Completed [159/461] on J0 in 5.89s, 21 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.TestCodecLoadingDeadlock
[junit4] Completed [160/461] on J0 in 0.58s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanMultiTermQueryWrapper
[junit4] Completed [161/461] on J0 in 0.09s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestCodecs
[junit4] Completed [162/461] on J0 in 0.36s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.perfield.TestPerFieldDocValuesFormat
[junit4] Completed [163/461] on J2 in 46.91s, 110 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterMerging
[junit4] Completed [164/461] on J2 in 1.57s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterWithThreads
[junit4] IGNOR/A 0.01s J2 | TestIndexWriterWithThreads.testOpenTwoIndexWritersOnDifferentThreads
[junit4] > Assumption #1: aborting test: timeout obtaining lock
[junit4] Completed [165/461] on J2 in 1.21s, 12 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestGraphTokenizers
[junit4] Completed [166/461] on J2 in 4.89s, 23 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestAddIndexes
[junit4] Completed [167/461] on J2 in 1.83s, 25 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestBagOfPositions
[junit4] Completed [168/461] on J0 in 34.45s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDeletionPolicy
[junit4] Completed [169/461] on J0 in 3.19s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestShardSearching
[junit4] Completed [170/461] on J2 in 10.10s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterExceptions
[junit4] IGNOR/A 0.00s J2 | TestIndexWriterExceptions.testTooManyTokens
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [171/461] on J2 in 6.40s, 34 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.store.TestMultiMMap
[junit4] Completed [172/461] on J2 in 2.19s, 54 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSearcherManager
[junit4] Completed [173/461] on J2 in 18.50s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestBasics
[junit4] Completed [174/461] on J2 in 1.33s, 27 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSloppyPhraseQuery
[junit4] Completed [175/461] on J2 in 0.54s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestPersistentSnapshotDeletionPolicy
[junit4] Completed [176/461] on J2 in 1.45s, 13 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestAtomicUpdate
[junit4] Completed [177/461] on J2 in 4.74s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestStressAdvance
[junit4] Completed [178/461] on J2 in 1.54s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.analysis.standard.TestStandardAnalyzer
[junit4] Completed [179/461] on J2 in 9.27s, 36 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDirectoryReaderReopen
[junit4] Completed [180/461] on J2 in 1.56s, 14 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNeverDelete
[junit4] Completed [181/461] on J2 in 4.18s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestLongPostings
[junit4] Completed [182/461] on J2 in 4.41s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterUnicode
[junit4] Completed [183/461] on J2 in 2.98s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.TestLevenshteinAutomata
[junit4] Completed [184/461] on J2 in 1.22s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSegmentMerger
[junit4] Completed [185/461] on J2 in 0.38s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestPhraseQuery
[junit4] Completed [186/461] on J2 in 0.87s, 21 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene70.TestLucene70DocValuesFormat
[junit4] IGNOR/A 0.00s J1 | TestLucene70DocValuesFormat.testSortedSetVariableLengthManyVsStoredFields
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J1 | TestLucene70DocValuesFormat.testTermsEnumRandomMany
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J1 | TestLucene70DocValuesFormat.testSortedVariableLengthManyVsStoredFields
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [187/461] on J1 in 262.35s, 126 tests, 3 skipped
[junit4]
[junit4] Suite: org.apache.lucene.store.TestRAMDirectory
[junit4] IGNOR/A 0.00s J1 | TestRAMDirectory.testFsyncDoesntCreateNewFiles
[junit4] > Assumption #1: test only works for FSDirectory subclasses
[junit4] IGNOR/A 0.00s J1 | TestRAMDirectory.testPendingDeletions
[junit4] > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
[junit4] Completed [188/461] on J1 in 0.64s, 46 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestCheckIndex
[junit4] Completed [189/461] on J1 in 0.32s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestParallelReaderEmptyIndex
[junit4] Completed [190/461] on J1 in 0.04s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestPositiveScoresOnlyCollector
[junit4] Completed [191/461] on J1 in 0.04s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat3
[junit4] Completed [192/461] on J1 in 1.08s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestPrefixRandom
[junit4] Completed [193/461] on J1 in 1.09s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.TestDeterminism
[junit4] Completed [194/461] on J1 in 0.94s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSizeBoundedForceMerge
[junit4] Completed [195/461] on J1 in 0.11s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTermsEnum2
[junit4] Completed [196/461] on J1 in 0.87s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestCollectionUtil
[junit4] Completed [197/461] on J2 in 7.81s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestOmitNorms
[junit4] Completed [198/461] on J2 in 0.45s, 5 tests
[junit4]
[junit4] HEARTBEAT J0 PID(4150@localhost): 2018-02-09T00:05:38, stalled for 62.8s at: TestTermsEnum.testVaryingTermsPerSegment
[junit4] Suite: org.apache.lucene.util.TestFixedBitSet
[junit4] Completed [199/461] on J2 in 4.45s, 19 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestComplexExplanations
[junit4] Completed [200/461] on J2 in 0.70s, 21 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestNRTCachingDirectory
[junit4] IGNOR/A 0.00s J2 | TestNRTCachingDirectory.testFsyncDoesntCreateNewFiles
[junit4] > Assumption #1: test only works for FSDirectory subclasses
[junit4] IGNOR/A 0.00s J2 | TestNRTCachingDirectory.testPendingDeletions
[junit4] > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
[junit4] Completed [201/461] on J2 in 1.32s, 44 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.codecs.compressing.TestFastDecompressionMode
[junit4] Completed [202/461] on J2 in 2.14s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestParallelCompositeReader
[junit4] Completed [203/461] on J2 in 0.12s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestFieldCacheRewriteMethod
[junit4] Completed [204/461] on J2 in 1.83s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestPagedBytes
[junit4] Completed [205/461] on J2 in 7.33s, 4 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTransactions
[junit4] Completed [206/461] on J2 in 1.94s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestCrash
[junit4] Completed [207/461] on J2 in 0.15s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.perfield.TestPerFieldPostingsFormat2
[junit4] Completed [208/461] on J2 in 4.94s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSort
[junit4] Completed [209/461] on J2 in 0.09s, 25 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestToken
[junit4] Completed [210/461] on J2 in 0.01s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.similarities.TestSimilarityBase
[junit4] Completed [211/461] on J2 in 0.19s, 31 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestHugeRamFile
[junit4] Completed [212/461] on J2 in 0.90s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBooleanMinShouldMatch
[junit4] Completed [213/461] on J2 in 1.41s, 17 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpans
[junit4] Completed [214/461] on J2 in 0.31s, 26 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestCustomNorms
[junit4] Completed [215/461] on J2 in 1.32s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMixedCodecs
[junit4] Completed [216/461] on J2 in 1.22s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFlex
[junit4] Completed [217/461] on J2 in 0.04s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.TestUTF32ToUTF8
[junit4] Completed [218/461] on J2 in 3.51s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.compressing.TestFastCompressionMode
[junit4] Completed [219/461] on J2 in 0.83s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestStressIndexing2
[junit4] Completed [220/461] on J2 in 0.56s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestLazyProxSkipping
[junit4] Completed [221/461] on J2 in 0.10s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.TestMergeSchedulerExternal
[junit4] Completed [222/461] on J2 in 0.58s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestOmitPositions
[junit4] Completed [223/461] on J2 in 0.14s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestParallelLeafReader
[junit4] Completed [224/461] on J2 in 0.15s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestBytesRefHash
[junit4] Completed [225/461] on J2 in 1.42s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestThreadedForceMerge
[junit4] Completed [226/461] on J2 in 0.24s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestStressNRT
[junit4] Completed [227/461] on J2 in 1.36s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSloppyPhraseQuery2
[junit4] Completed [228/461] on J2 in 0.74s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestDisjunctionMaxQuery
[junit4] Completed [229/461] on J2 in 0.19s, 13 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestNearSpansOrdered
[junit4] Completed [230/461] on J2 in 0.11s, 19 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSameScoresWithThreads
[junit4] Completed [231/461] on J2 in 0.47s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestScorerPerf
[junit4] Completed [232/461] on J2 in 4.19s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestLiveFieldValues
[junit4] Completed [233/461] on J2 in 1.15s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanSearchEquivalence
[junit4] Completed [234/461] on J2 in 1.40s, 33 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
[junit4] Completed [235/461] on J2 in 3.24s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestPayloads
[junit4] Completed [236/461] on J2 in 0.05s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestWildcard
[junit4] Completed [237/461] on J2 in 0.03s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSimpleExplanationsOfNonMatches
[junit4] Completed [238/461] on J2 in 0.06s, 70 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestRegexpQuery
[junit4] Completed [239/461] on J2 in 0.02s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestPerSegmentDeletes
[junit4] Completed [240/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIntBlockPool
[junit4] Completed [241/461] on J2 in 0.30s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTopDocsCollector
[junit4] Completed [242/461] on J2 in 0.02s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSegmentTermEnum
[junit4] Completed [243/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestUniqueTermCount
[junit4] Completed [244/461] on J2 in 0.02s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestComplexExplanationsOfNonMatches
[junit4] Completed [245/461] on J2 in 0.04s, 21 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestPrefixCodedTerms
[junit4] Completed [246/461] on J2 in 0.10s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestAllFilesHaveCodecHeader
[junit4] Completed [247/461] on J2 in 0.11s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.document.TestDocument
[junit4] Completed [248/461] on J2 in 0.02s, 12 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMaxTermFrequency
[junit4] Completed [249/461] on J2 in 0.12s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTopFieldCollector
[junit4] Completed [250/461] on J2 in 0.09s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestDocValuesScoring
[junit4] Completed [251/461] on J2 in 0.04s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestWildcardRandom
[junit4] Completed [252/461] on J2 in 0.07s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestRegexpRandom
[junit4] Completed [253/461] on J2 in 0.06s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBooleanQueryVisitSubscorers
[junit4] Completed [254/461] on J2 in 0.03s, 7 tests
[junit4]
[junit4] HEARTBEAT J0 PID(4150@localhost): 2018-02-09T00:06:38, stalled for 123s at: TestTermsEnum.testVaryingTermsPerSegment
[junit4] HEARTBEAT J1 PID(4151@localhost): 2018-02-09T00:06:38, stalled for 62.0s at: TestIndexingSequenceNumbers.testStressConcurrentCommit
[junit4] Suite: org.apache.lucene.TestSearchForDuplicates
[junit4] Completed [255/461] on J2 in 0.03s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexFileDeleter
[junit4] Completed [256/461] on J2 in 0.65s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMatchAllDocsQuery
[junit4] Completed [257/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestPrefixQuery
[junit4] Completed [258/461] on J2 in 2.25s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestBinaryTerms
[junit4] Completed [259/461] on J2 in 0.02s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestRecyclingIntBlockAllocator
[junit4] Completed [260/461] on J2 in 0.68s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestPositionIncrement
[junit4] Completed [261/461] on J2 in 0.02s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSimilarity
[junit4] Completed [262/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanExplanationsOfNonMatches
[junit4] Completed [263/461] on J2 in 0.02s, 30 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestVirtualMethod
[junit4] Completed [264/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestSmallFloat
[junit4] Completed [265/461] on J2 in 0.09s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSimilarityProvider
[junit4] Completed [266/461] on J2 in 0.02s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestSetOnce
[junit4] Completed [267/461] on J2 in 0.02s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.TestSearch
[junit4] Completed [268/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestCachingTokenFilter
[junit4] Completed [269/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestFilterIterator
[junit4] Completed [270/461] on J2 in 0.02s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.document.TestDateTools
[junit4] Completed [271/461] on J2 in 0.01s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestPriorityQueue
[junit4] Completed [272/461] on J2 in 0.17s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BPostings
[junit4] IGNOR/A 0.00s J2 | Test2BPostings.test
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [273/461] on J2 in 0.00s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSameTokenSamePosition
[junit4] Completed [274/461] on J2 in 0.02s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocCount
[junit4] Completed [275/461] on J2 in 0.03s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestCachingCollector
[junit4] Completed [276/461] on J2 in 0.02s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestAttributeSource
[junit4] Completed [277/461] on J2 in 0.01s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTotalHitCountCollector
[junit4] Completed [278/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestRecyclingByteBlockAllocator
[junit4] Completed [279/461] on J2 in 0.11s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanFirstQuery
[junit4] Completed [280/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNoMergePolicy
[junit4] Completed [281/461] on J2 in 0.04s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestNamedSPILoader
[junit4] Completed [282/461] on J2 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterLockRelease
[junit4] Completed [283/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestPhrasePrefixQuery
[junit4] Completed [284/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestBytesRef
[junit4] Completed [285/461] on J2 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.TestDemo
[junit4] Completed [286/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestCharFilter
[junit4] Completed [287/461] on J2 in 0.01s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestRollback
[junit4] Completed [288/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestNot
[junit4] Completed [289/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestCloseableThreadLocal
[junit4] Completed [290/461] on J2 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterOnJRECrash
[junit4] IGNOR/A 0.00s J2 | TestIndexWriterOnJRECrash.testNRTThreads
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [291/461] on J2 in 0.00s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.Test4GBStoredFields
[junit4] IGNOR/A 0.00s J2 | Test4GBStoredFields.test
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [292/461] on J2 in 0.00s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestCodecHoldsOpenFiles
[junit4] Completed [293/461] on J2 in 0.02s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestScoreCachingWrappingScorer
[junit4] Completed [294/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.TestIntsRef
[junit4] Completed [295/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestSimpleAttributeImpl
[junit4] Completed [296/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTermdocPerf
[junit4] Completed [297/461] on J2 in 0.00s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BPositions
[junit4] IGNOR/A 0.00s J2 | Test2BPositions.test
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=uses lots of space and takes a few minutes))
[junit4] Completed [298/461] on J2 in 0.00s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexCommit
[junit4] Completed [299/461] on J2 in 0.00s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTerm
[junit4] Completed [300/461] on J2 in 0.00s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTermsEnum
[junit4] Completed [301/461] on J0 in 148.00s, 13 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestNGramPhraseQuery
[junit4] Completed [302/461] on J0 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNoDeletionPolicy
[junit4] Completed [303/461] on J0 in 0.02s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestBufferedChecksum
[junit4] Completed [304/461] on J0 in 0.03s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestFilterSpans
[junit4] Completed [305/461] on J0 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanContainQuery
[junit4] Completed [306/461] on J0 in 0.02s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMultiTermQueryRewrites
[junit4] Completed [307/461] on J0 in 0.02s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BPostingsBytes
[junit4] IGNOR/A 0.00s J2 | Test2BPostingsBytes.test
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~20GB-30GB of space and 10 minutes))
[junit4] Completed [308/461] on J2 in 0.00s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.util.TestIOUtils
[junit4] Completed [309/461] on J0 in 0.06s, 18 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BNumericDocValues
[junit4] IGNOR/A 0.00s J2 | Test2BNumericDocValues.testNumerics
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~ 2 hours if the heap is 5gb))
[junit4] Completed [310/461] on J2 in 0.00s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.Test2BBinaryDocValues
[junit4] IGNOR/A 0.00s J0 | Test2BBinaryDocValues.testFixedBinary
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~ 6 hours if the heap is 5gb))
[junit4] IGNOR/A 0.00s J0 | Test2BBinaryDocValues.testVariableBinary
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~ 6 hours if the heap is 5gb))
[junit4] Completed [311/461] on J0 in 0.00s, 2 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.util.Test2BPagedBytes
[junit4] IGNOR/A 0.00s J2 | Test2BPagedBytes.test
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=You must increase heap to > 2 G to run this))
[junit4] Completed [312/461] on J2 in 0.00s, 1 test, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestCharArraySet
[junit4] Completed [313/461] on J0 in 0.03s, 15 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestDelegatingAnalyzerWrapper
[junit4] Completed [314/461] on J2 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestReusableStringReader
[junit4] Completed [315/461] on J0 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestStopFilter
[junit4] Completed [316/461] on J2 in 0.01s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.TestWordlistLoader
[junit4] Completed [317/461] on J0 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestPackedTokenAttributeImpl
[junit4] Completed [318/461] on J2 in 0.01s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.TestCodecUtil
[junit4] Completed [319/461] on J0 in 0.01s, 16 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestForUtil
[junit4] Completed [320/461] on J0 in 0.05s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat2
[junit4] Completed [321/461] on J2 in 0.88s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50CompoundFormat
[junit4] Completed [322/461] on J0 in 2.49s, 26 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene60FieldInfoFormat
[junit4] Completed [323/461] on J0 in 0.29s, 11 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50StoredFieldsFormatHighCompression
[junit4] IGNOR/A 0.00s J2 | TestLucene50StoredFieldsFormatHighCompression.testBigDocuments
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [324/461] on J2 in 5.81s, 19 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene60.TestLucene60PointsFormat
[junit4] IGNOR/A 0.00s J0 | TestLucene60PointsFormat.testMergeStability
[junit4] > Assumption #1: TODO: mess with the parameters and test gets angry!
[junit4] IGNOR/A 0.00s J0 | TestLucene60PointsFormat.testRandomBinaryBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [325/461] on J0 in 4.41s, 20 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene70.TestLucene70SegmentInfoFormat
[junit4] Completed [326/461] on J0 in 0.28s, 16 tests
[junit4]
[junit4] Suite: org.apache.lucene.geo.TestGeoEncodingUtils
[junit4] Completed [327/461] on J0 in 0.62s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestAllFilesCheckIndexHeader
[junit4] Completed [328/461] on J0 in 0.24s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestAllFilesDetectTruncation
[junit4] Completed [329/461] on J0 in 0.23s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestAllFilesHaveChecksumFooter
[junit4] Completed [330/461] on J0 in 0.10s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestBinaryDocValuesUpdates
[junit4] IGNOR/A 0.00s J0 | TestBinaryDocValuesUpdates.testTonsOfUpdates
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [331/461] on J0 in 4.35s, 29 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDemoParallelLeafReader
[junit4] Completed [332/461] on J0 in 3.67s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocValues
[junit4] Completed [333/461] on J0 in 0.04s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFieldInvertState
[junit4] Completed [334/461] on J0 in 0.06s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexManyDocuments
[junit4] Completed [335/461] on J0 in 0.18s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexReaderClose
[junit4] Completed [336/461] on J0 in 0.20s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterFromReader
[junit4] Completed [337/461] on J0 in 0.16s, 12 tests
[junit4]
[junit4] Suite: org.apache.lucene.codecs.lucene70.TestLucene70NormsFormat
[junit4] IGNOR/A 0.00s J2 | TestLucene70NormsFormat.testSparseNCommonBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J2 | TestLucene70NormsFormat.testNCommonBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J2 | TestLucene70NormsFormat.testMergeStability
[junit4] > Assumption #1: The MockRandom PF randomizes content on the fly, so we can't check it
[junit4] Completed [338/461] on J2 in 12.73s, 29 tests, 3 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterMaxDocs
[junit4] IGNOR/A 0.00s J0 | TestIndexWriterMaxDocs.testExactlyAtTrueLimit
[junit4] > Assumption #1: 'monster' test group is disabled (@Monster(value=takes over two hours))
[junit4] Completed [339/461] on J0 in 1.35s, 21 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestInfoStream
[junit4] Completed [340/461] on J0 in 0.02s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMaxPosition
[junit4] Completed [341/461] on J0 in 0.03s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMergeRateLimiter
[junit4] Completed [342/461] on J0 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexingSequenceNumbers
[junit4] Completed [343/461] on J1 in 102.53s, 8 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterOutOfFileDescriptors
[junit4] Completed [344/461] on J2 in 2.86s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterOnVMError
[junit4] IGNOR/A 0.00s J1 | TestIndexWriterOnVMError.testCheckpoint
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [345/461] on J1 in 0.32s, 3 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMultiTermsEnum
[junit4] Completed [346/461] on J2 in 0.02s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNRTReaderCleanup
[junit4] Completed [347/461] on J2 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestOrdinalMap
[junit4] Completed [348/461] on J2 in 0.06s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestReadOnlyIndex
[junit4] Completed [349/461] on J2 in 0.19s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestReaderWrapperDVTypeCheck
[junit4] Completed [350/461] on J2 in 0.06s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMixedDocValuesUpdates
[junit4] IGNOR/A 0.00s J0 | TestMixedDocValuesUpdates.testTonsOfUpdates
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [351/461] on J0 in 2.47s, 4 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestSortedSetDocValues
[junit4] Completed [352/461] on J2 in 0.03s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTermVectors
[junit4] Completed [353/461] on J2 in 0.23s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestStressDeletes
[junit4] Completed [354/461] on J0 in 0.43s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTragicIndexWriterDeadlock
[junit4] Completed [355/461] on J2 in 0.07s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTryDelete
[junit4] Completed [356/461] on J0 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TermInSetQueryTest
[junit4] Completed [357/461] on J2 in 0.97s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestApproximationSearchEquivalence
[junit4] Completed [358/461] on J0 in 0.77s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterExceptions2
[junit4] Completed [359/461] on J1 in 7.64s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestControlledRealTimeReopenThread
[junit4] IGNOR/A 0.00s J0 | TestControlledRealTimeReopenThread.testCRTReopen
[junit4] > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/LUCENE-5737))
[junit4] Completed [360/461] on J0 in 4.33s, 6 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestConjunctionDISI
[junit4] Completed [361/461] on J2 in 6.54s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestDoubleRangeFieldQueries
[junit4] IGNOR/A 0.00s J2 | TestDoubleRangeFieldQueries.testRandomBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [362/461] on J2 in 5.21s, 5 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestDocValuesQueries
[junit4] Completed [363/461] on J0 in 8.39s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestFilterWeight
[junit4] Completed [364/461] on J0 in 0.02s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMatchNoDocsQuery
[junit4] Completed [365/461] on J0 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterDelete
[junit4] IGNOR/A 0.00s J1 | TestIndexWriterDelete.testApplyDeletesOnFlush
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [366/461] on J1 in 10.39s, 25 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSortRandom
[junit4] Completed [367/461] on J1 in 0.71s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMultiTermConstantScore
[junit4] Completed [368/461] on J1 in 0.39s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNorms
[junit4] Completed [369/461] on J1 in 0.70s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDocumentsWriterDeleteQueue
[junit4] Completed [370/461] on J1 in 0.10s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFilterLeafReader
[junit4] Completed [371/461] on J1 in 0.05s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTimeLimitingCollector
[junit4] Completed [372/461] on J1 in 2.74s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestCustomTermFreq
[junit4] Completed [373/461] on J1 in 0.04s, 12 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMinShouldMatch2
[junit4] Completed [374/461] on J0 in 6.34s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestMultiPhraseEnum
[junit4] Completed [375/461] on J0 in 0.05s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestNormsFieldExistsQuery
[junit4] Completed [376/461] on J0 in 2.19s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestEarlyTerminatingSortingCollector
[junit4] Completed [377/461] on J2 in 12.59s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestReqExclBulkScorer
[junit4] Completed [378/461] on J2 in 0.02s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSegmentCacheables
[junit4] Completed [379/461] on J2 in 0.03s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSortedNumericSortField
[junit4] Completed [380/461] on J2 in 0.03s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestSynonymQuery
[junit4] Completed [381/461] on J2 in 0.01s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTermQuery
[junit4] Completed [382/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestLongRangeFieldQueries
[junit4] IGNOR/A 0.00s J1 | TestLongRangeFieldQueries.testRandomBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [383/461] on J1 in 6.65s, 5 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.util.automaton.TestMinimize
[junit4] Completed [384/461] on J1 in 1.82s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestPointQueries
[junit4] IGNOR/A 0.00s J0 | TestPointQueries.testRandomBinaryBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J0 | TestPointQueries.testRandomLongsBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [385/461] on J0 in 5.94s, 49 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestOmitTf
[junit4] Completed [386/461] on J1 in 0.41s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.similarities.TestBooleanSimilarity
[junit4] Completed [387/461] on J0 in 0.03s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestBoolean2ScorerSupplier
[junit4] Completed [388/461] on J1 in 0.12s, 10 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanNearQuery
[junit4] Completed [389/461] on J0 in 0.02s, 4 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanTermQuery
[junit4] Completed [390/461] on J0 in 0.02s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestFilterDirectory
[junit4] IGNOR/A 0.00s J0 | TestFilterDirectory.testFsyncDoesntCreateNewFiles
[junit4] > Assumption #1: test only works for FSDirectory subclasses
[junit4] IGNOR/A 0.00s J0 | TestFilterDirectory.testPendingDeletions
[junit4] > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
[junit4] Completed [391/461] on J0 in 0.50s, 44 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestTieredMergePolicy
[junit4] Completed [392/461] on J1 in 2.31s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.TestAutomatonQueryUnicode
[junit4] Completed [393/461] on J1 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestForTooMuchCloning
[junit4] Completed [394/461] on J1 in 0.06s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestFilterDirectoryReader
[junit4] Completed [395/461] on J1 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.index.TestMultiDocValues
[junit4] Completed [396/461] on J1 in 0.25s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestNoMergeScheduler
[junit4] Completed [397/461] on J1 in 0.02s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.TestExternalCodecs
[junit4] Completed [398/461] on J1 in 0.21s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.util.fst.TestFSTs
[junit4] IGNOR/A 0.00s J1 | TestFSTs.testBigSet
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [399/461] on J1 in 4.53s, 20 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.index.TestDuelingCodecsAtNight
[junit4] IGNOR/A 0.00s J1 | TestDuelingCodecsAtNight.testBigEquals
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J1 | TestDuelingCodecsAtNight.testCrazyReaderEquals
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J1 | TestDuelingCodecsAtNight.testEquals
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] Completed [400/461] on J1 in 0.00s, 3 tests, 3 skipped
[junit4]
[junit4] Suite: org.apache.lucene.document.TestFieldType
[junit4] Completed [401/461] on J1 in 0.01s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.search.spans.TestSpanBoostQuery
[junit4] Completed [402/461] on J1 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.geo.TestPolygon
[junit4] Completed [403/461] on J1 in 0.03s, 15 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestByteArrayDataInput
[junit4] Completed [404/461] on J1 in 0.01s, 1 test
[junit4]
[junit4] Suite: org.apache.lucene.search.TestTopFieldCollectorEarlyTermination
[junit4] Completed [405/461] on J2 in 11.28s, 3 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestMmapDirectory
[junit4] Completed [406/461] on J2 in 0.81s, 43 tests, 1 skipped
[junit4]
[junit4] Suite: org.apache.lucene.store.TestRateLimiter
[junit4] Completed [407/461] on J2 in 0.76s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestGrowableByteArrayDataOutput
[junit4] Completed [408/461] on J0 in 9.31s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestSingleInstanceLockFactory
[junit4] Completed [409/461] on J0 in 1.24s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestSimpleFSLockFactory
[junit4] Completed [410/461] on J2 in 4.19s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestTrackingDirectoryWrapper
[junit4] IGNOR/A 0.00s J2 | TestTrackingDirectoryWrapper.testFsyncDoesntCreateNewFiles
[junit4] > Assumption #1: test only works for FSDirectory subclasses
[junit4] IGNOR/A 0.00s J2 | TestTrackingDirectoryWrapper.testPendingDeletions
[junit4] > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
[junit4] Completed [411/461] on J2 in 0.46s, 47 tests, 2 skipped
[junit4]
[junit4] Suite: org.apache.lucene.util.TestCharsRefBuilder
[junit4] Completed [412/461] on J2 in 0.01s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestDocIdSetBuilder
[junit4] Completed [413/461] on J2 in 0.80s, 7 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestFixedBitDocIdSet
[junit4] Completed [414/461] on J2 in 0.47s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestFixedLengthBytesRefArray
[junit4] Completed [415/461] on J2 in 0.07s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestFrequencyTrackingRingBuffer
[junit4] Completed [416/461] on J2 in 0.25s, 2 tests
[junit4]
[junit4] Suite: org.apache.lucene.index.TestIndexSorting
[junit4] Completed [417/461] on J1 in 10.66s, 50 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestIntArrayDocIdSet
[junit4] Completed [418/461] on J2 in 0.43s, 5 tests
[junit4]
[junit4] Suite: org.apache.lucene.store.TestSleepingLockWrapper
[junit4] Completed [419/461] on J0 in 6.46s, 6 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestIntroSorter
[junit4] Completed [420/461] on J0 in 0.07s, 9 tests
[junit4]
[junit4] Suite: org.apache.lucene.util.TestIntroSelector
[junit4] Completed [421/461]
[...truncated too long message...]
ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
common.resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/null894739408
[copy] Copying 39 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/null894739408
[delete] Deleting directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/null894739408
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/null1409936233
[copy] Copying 227 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/null1409936233
[delete] Deleting directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/null1409936233
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 333ms :: artifacts dl 1ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 90 minutes 30 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
WARN: no matches found within 10000
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=8a370fa900512a48aa460430cb15c92ed3733020, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1319
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)