You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2019/02/07 08:37:06 UTC
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build #
23634 - Failure!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23634/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeLost/127.0.0.1:45699_solr exists
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeLost/127.0.0.1:45699_solr exists
at __randomizedtesting.SeedInfo.seed([A432A932DA0EDD7:12F9A29F23952038]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertFalse(Assert.java:64)
at org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest.testNodeMarkersRegistration(NodeMarkersRegistrationTest.java:152)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 14393 lines...]
[junit4] JVM J1: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20190207_080025_6107622820522814555458.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # A fatal error has been detected by the Java Runtime Environment:
[junit4] #
[junit4] # SIGSEGV (0xb) at pc=0x00007f9e2f043dc9, pid=31929, tid=31963
[junit4] #
[junit4] # JRE version: Java(TM) SE Runtime Environment (9.0+11) (build 9.0.4+11)
[junit4] # Java VM: Java HotSpot(TM) 64-Bit Server VM (9.0.4+11, mixed mode, tiered, serial gc, linux-amd64)
[junit4] # Problematic frame:
[junit4] # V [libjvm.so+0xc5adc9] PhaseIdealLoop::split_up(Node*, Node*, Node*) [clone .part.40]+0x619
[junit4] #
[junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
[junit4] #
[junit4] # An error report file with more information is saved as:
[junit4] # /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/hs_err_pid31929.log
[junit4] #
[junit4] # Compiler replay data is saved as:
[junit4] # /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/replay_pid31929.log
[junit4] #
[junit4] # If you would like to submit a bug report, please visit:
[junit4] # http://bugreport.java.com/bugreport/crash.jsp
[junit4] #
[junit4] <<< JVM J1: EOF ----
[...truncated 197 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest
[junit4] 2> 1463345 INFO (SUITE-NodeMarkersRegistrationTest-seed#[A432A932DA0EDD7]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_A432A932DA0EDD7-001/init-core-data-001
[junit4] 2> 1463346 INFO (SUITE-NodeMarkersRegistrationTest-seed#[A432A932DA0EDD7]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1463346 INFO (SUITE-NodeMarkersRegistrationTest-seed#[A432A932DA0EDD7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 1463348 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeMarkersRegistration
[junit4] 2> 1463348 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_A432A932DA0EDD7-001/tempDir-001
[junit4] 2> 1463348 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1463348 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1463349 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1463449 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkTestServer start zk server on port:32869
[junit4] 2> 1463449 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:32869
[junit4] 2> 1463449 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 32869
[junit4] 2> 1463451 INFO (zkConnectionManagerCallback-9821-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463453 INFO (zkConnectionManagerCallback-9823-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463454 INFO (zkConnectionManagerCallback-9825-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463455 WARN (jetty-launcher-9826-thread-2) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 1463455 WARN (jetty-launcher-9826-thread-1) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 1463455 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 1463455 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 1463455 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1463455 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1463455 INFO (jetty-launcher-9826-thread-1) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 9.0.4+11
[junit4] 2> 1463455 INFO (jetty-launcher-9826-thread-2) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 9.0.4+11
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@44c9bca3{/solr,null,AVAILABLE}
[junit4] 2> 1463456 INFO (jetty-launcher-9826-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8485c2f{/solr,null,AVAILABLE}
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@41240a78{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:45699}
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@528407fa{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:43485}
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.e.j.s.Server Started @1463525ms
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.e.j.s.Server Started @1463525ms
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43485}
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45699}
[junit4] 2> 1463458 ERROR (jetty-launcher-9826-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1463458 ERROR (jetty-launcher-9826-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-02-07T08:24:49.186645Z
[junit4] 2> 1463458 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-02-07T08:24:49.186640Z
[junit4] 2> 1463459 INFO (zkConnectionManagerCallback-9829-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463459 INFO (zkConnectionManagerCallback-9830-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463460 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1463460 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1463522 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1463523 WARN (jetty-launcher-9826-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@34ec43d5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1463524 WARN (jetty-launcher-9826-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@3700ce04[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1463525 INFO (jetty-launcher-9826-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:32869/solr
[junit4] 2> 1463526 INFO (zkConnectionManagerCallback-9836-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463527 INFO (zkConnectionManagerCallback-9838-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463551 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45699_solr
[junit4] 2> 1463551 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.c.Overseer Overseer (id=72067284613267462-127.0.0.1:45699_solr-n_0000000000) starting
[junit4] 2> 1463553 INFO (zkConnectionManagerCallback-9845-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463554 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:32869/solr ready
[junit4] 2> 1463554 INFO (OverseerStateUpdate-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [n:127.0.0.1:45699_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:45699_solr
[junit4] 2> 1463554 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45699_solr
[junit4] 2> 1463554 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1463555 INFO (zkCallback-9844-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1463555 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1463555 INFO (zkCallback-9837-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1463555 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 1463555 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1463556 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:45699_solr]
[junit4] 2> 1463556 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
[junit4] 2> 1463556 DEBUG (ScheduledTrigger-8499-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 and last live nodes: 1
[junit4] 2> 1463556 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1463566 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1463581 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45699.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463588 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45699.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463588 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45699.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463589 INFO (jetty-launcher-9826-thread-1) [n:127.0.0.1:45699_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_A432A932DA0EDD7-001/tempDir-001/node2/.
[junit4] 2> 1463637 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1463638 WARN (jetty-launcher-9826-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@727af181[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1463639 WARN (jetty-launcher-9826-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@37fce67[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1463640 INFO (jetty-launcher-9826-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:32869/solr
[junit4] 2> 1463641 INFO (zkConnectionManagerCallback-9852-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463643 INFO (zkConnectionManagerCallback-9854-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463645 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1463646 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:43485_solr as DOWN
[junit4] 2> 1463646 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1463646 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43485_solr
[junit4] 2> 1463647 INFO (zkCallback-9837-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1463647 INFO (zkCallback-9844-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1463647 INFO (zkCallback-9853-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1463655 INFO (zkConnectionManagerCallback-9861-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463656 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1463657 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:32869/solr ready
[junit4] 2> 1463657 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1463665 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43485.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463670 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43485.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463670 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43485.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463671 INFO (jetty-launcher-9826-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_A432A932DA0EDD7-001/tempDir-001/node1/.
[junit4] 2> 1463684 INFO (zkConnectionManagerCallback-9867-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463685 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1463686 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:32869/solr ready
[junit4] 2> 1463688 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1463690 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463691 INFO (qtp1671753917-27927) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463691 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463691 INFO (qtp1671753917-27927) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463691 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463693 INFO (qtp1963676706-27932) [n:127.0.0.1:45699_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463693 INFO (qtp1963676706-27933) [n:127.0.0.1:45699_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463693 INFO (qtp1963676706-27930) [n:127.0.0.1:45699_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463694 INFO (qtp1963676706-27932) [n:127.0.0.1:45699_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463694 INFO (qtp1963676706-27933) [n:127.0.0.1:45699_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1463695 DEBUG (qtp1671753917-27931) [n:127.0.0.1:43485_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1463695 INFO (qtp1671753917-27931) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 1463695 DEBUG (zkCallback-9844-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1463696 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1463696 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1463708 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
[junit4] 2> 1463708 DEBUG (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1463709 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=13
[junit4] 2> 1463710 WARN (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 1463710 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 1463710 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1463710 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 9.0.4+11
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@419c8ebe{/solr,null,AVAILABLE}
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5f02bdac{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:44555}
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.Server Started @1463778ms
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44555}
[junit4] 2> 1463711 ERROR (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1463711 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-02-07T08:24:49.439801Z
[junit4] 2> 1463712 INFO (zkConnectionManagerCallback-9869-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463713 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1463817 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1463817 WARN (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@54028e57[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1463819 WARN (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@6253dc39[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1463820 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:32869/solr
[junit4] 2> 1463821 INFO (zkConnectionManagerCallback-9875-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463823 INFO (zkConnectionManagerCallback-9877-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463825 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1463826 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:44555_solr as DOWN
[junit4] 2> 1463826 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1463826 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44555_solr
[junit4] 2> 1463826 INFO (zkCallback-9853-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1463826 INFO (zkCallback-9837-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1463826 INFO (zkCallback-9844-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1463826 INFO (zkCallback-9860-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1463826 INFO (zkCallback-9866-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1463827 INFO (zkCallback-9876-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1463835 INFO (zkConnectionManagerCallback-9884-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1463836 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1463836 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:32869/solr ready
[junit4] 2> 1463837 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1463847 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44555.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463854 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44555.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463854 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44555.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8551371
[junit4] 2> 1463854 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [n:127.0.0.1:44555_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_A432A932DA0EDD7-001/tempDir-001/node3/.
[junit4] 2> 1463878 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.a.NodeMarkersRegistrationTest ====== KILL OVERSEER 1
[junit4] 2> 1463878 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=758672546
[junit4] 2> 1463878 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:45699_solr
[junit4] 2> 1463879 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.CoreContainer Publish this node as DOWN...
[junit4] 2> 1463879 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:45699_solr as DOWN
[junit4] 2> 1463880 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1463880 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1463880 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12996d62: rootName = solr_45699, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ad40112
[junit4] 2> 1463884 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1463884 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77319e24: rootName = solr_45699, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@14dbe130
[junit4] 2> 1463886 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1463886 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@614a1ff9: rootName = solr_45699, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@56cfd06
[junit4] 2> 1463886 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1463887 INFO (closeThreadPool-9888-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72067284613267462-127.0.0.1:45699_solr-n_0000000000) closing
[junit4] 1> Done close org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7240276e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 1> Done close org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3cfff34f[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> 1463887 INFO (OverseerStateUpdate-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [n:127.0.0.1:45699_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45699_solr
[junit4] 2> 1463887 INFO (OverseerAutoScalingTriggerThread-72067284613267462-127.0.0.1:45699_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1463888 DEBUG (closeThreadPool-9888-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 1463888 DEBUG (closeThreadPool-9888-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 1463888 DEBUG (closeThreadPool-9888-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 1463888 DEBUG (closeThreadPool-9888-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 1463888 INFO (zkCallback-9860-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1463888 INFO (zkCallback-9853-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1463888 DEBUG (closeThreadPool-9888-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 1463888 DEBUG (closeThreadPool-9888-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1463888 INFO (zkCallback-9866-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1463888 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.Overseer Overseer (id=72067284613267462-127.0.0.1:45699_solr-n_0000000000) closing
[junit4] 2> 1463889 INFO (closeThreadPool-9888-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72067284613267462-127.0.0.1:45699_solr-n_0000000000) closing
[junit4] 2> 1463889 INFO (zkCallback-9853-thread-2) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43485_solr
[junit4] 2> 1463889 INFO (zkCallback-9853-thread-2) [n:127.0.0.1:43485_solr ] o.a.s.c.Overseer Overseer (id=72067284613267465-127.0.0.1:43485_solr-n_0000000001) starting
[junit4] 2> 1463889 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@41240a78{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1463889 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@44c9bca3{/solr,null,UNAVAILABLE}
[junit4] 2> 1463889 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1463890 INFO (OverseerStateUpdate-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [n:127.0.0.1:43485_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:43485_solr
[junit4] 2> 1463890 DEBUG (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1463890 DEBUG (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 0
[junit4] 2> 1463891 DEBUG (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1463891 DEBUG (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:44555_solr, 127.0.0.1:43485_solr]
[junit4] 2> 1463891 DEBUG (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.NodeLostTrigger Adding lost node from marker path: 127.0.0.1:45699_solr
[junit4] 2> 1463891 DEBUG (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
[junit4] 2> 1463891 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 1
[junit4] 2> 1463891 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:45699_solr
[junit4] 2> 1463891 DEBUG (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1463892 INFO (zkCallback-9876-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1463892 INFO (zkCallback-9883-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1464892 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1465892 DEBUG (ScheduledTrigger-8524-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1466892 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1467893 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1468891 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1468893 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1468893 INFO (qtp1671753917-27929) [n:127.0.0.1:43485_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1469893 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1470893 INFO (OverseerCollectionConfigSetProcessor-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [n:127.0.0.1:43485_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1470893 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1471893 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1472893 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1473894 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1474894 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1475894 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1476894 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1477894 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1478895 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1479895 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1480895 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1481895 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1482895 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1483896 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1484896 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1485896 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1486896 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1487896 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1488897 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1489897 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1490897 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1491897 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1492897 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1493897 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1494898 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1495898 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1496898 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1497898 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1498898 DEBUG (ScheduledTrigger-8524-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1498958 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=682804372
[junit4] 2> 1498958 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43485_solr
[junit4] 2> 1498958 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.c.CoreContainer Publish this node as DOWN...
[junit4] 2> 1498958 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:43485_solr as DOWN
[junit4] 2> 1498959 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1917736116
[junit4] 2> 1498959 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44555_solr
[junit4] 2> 1498959 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.c.CoreContainer Publish this node as DOWN...
[junit4] 2> 1498959 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:44555_solr as DOWN
[junit4] 2> 1498960 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1498960 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1498960 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d196546: rootName = solr_43485, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3b93c44d
[junit4] 2> 1498960 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@42804f68: rootName = solr_44555, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1229772b
[junit4] 2> 1498964 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1498964 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@25f1986a: rootName = solr_43485, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@14dbe130
[junit4] 2> 1498964 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1498965 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4461a1e1: rootName = solr_44555, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@14dbe130
[junit4] 2> 1498966 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1498966 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7947fd60: rootName = solr_43485, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@56cfd06
[junit4] 2> 1498966 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1498967 INFO (closeThreadPool-9894-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72067284613267465-127.0.0.1:43485_solr-n_0000000001) closing
[junit4] 1> Done close org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7b347dd7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> 1498967 INFO (OverseerStateUpdate-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [n:127.0.0.1:43485_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43485_solr
[junit4] 2> 1498968 INFO (OverseerAutoScalingTriggerThread-72067284613267465-127.0.0.1:43485_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1498968 DEBUG (closeThreadPool-9894-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 1498968 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1498969 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@736686d1: rootName = solr_44555, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@56cfd06
[junit4] 2> 1498969 INFO (jetty-closer-9889-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1498969 DEBUG (closeThreadPool-9894-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 1498969 DEBUG (closeThreadPool-9894-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 1498969 DEBUG (closeThreadPool-9894-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 1498969 DEBUG (closeThreadPool-9894-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 1498969 DEBUG (closeThreadPool-9894-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1498969 INFO (closeThreadPool-9894-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72067284613267465-127.0.0.1:43485_solr-n_0000000001) closing
[junit4] 1> Done close org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@1aaf7f18[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 1> Done close org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@1911df89[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> 1498970 INFO (jetty-closer-9889-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72067284613267465-127.0.0.1:43485_solr-n_0000000001) closing
[junit4] 2> 1498970 INFO (zkCallback-9876-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44555_solr
[junit4] 1> Done close org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@648a0c8a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> 1498972 INFO (zkCallback-9883-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 1498972 INFO (jetty-closer-9889-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@528407fa{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1498972 INFO (jetty-closer-9889-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@8485c2f{/solr,null,UNAVAILABLE}
[junit4] 2> 1498972 INFO (jetty-closer-9889-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1498973 INFO (jetty-closer-9889-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5f02bdac{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1498973 INFO (jetty-closer-9889-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@419c8ebe{/solr,null,UNAVAILABLE}
[junit4] 2> 1498973 INFO (jetty-closer-9889-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1498976 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1498980 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 3 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 1498981 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:32869
[junit4] 2> 1498981 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 32869
[junit4] 2> 1498982 INFO (TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[A432A932DA0EDD7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeMarkersRegistration
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=NodeMarkersRegistrationTest -Dtests.method=testNodeMarkersRegistration -Dtests.seed=A432A932DA0EDD7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ee-GH -Dtests.timezone=America/Belem -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 35.6s J2 | NodeMarkersRegistrationTest.testNodeMarkersRegistration <<<
[junit4] > Throwable #1: java.lang.AssertionError: Path /autoscaling/nodeLost/127.0.0.1:45699_solr exists
[junit4] > at __randomizedtesting.SeedInfo.seed([A432A932DA0EDD7:12F9A29F23952038]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest.testNodeMarkersRegistration(NodeMarkersRegistrationTest.java:152)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_A432A932DA0EDD7-001
[junit4] 2> Feb 07, 2019 8:25:24 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene80): {}, docValues:{}, maxPointsInLeafNode=1250, maxMBSortInHeap=7.249081068538796, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@73f3064), locale=ee-GH, timezone=America/Belem
[junit4] 2> NOTE: Linux 4.15.0-45-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=105404688,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [AnalyticsMergeStrategyTest, TaggerTest, TestBinaryResponseWriter, ParsingFieldUpdateProcessorsTest, BadComponentTest, BitVectorTest, TestSolrCoreSnapshots, DocValuesMissingTest, MoreLikeThisHandlerTest, SoftAutoCommitTest, TestConfigsApi, TestPHPSerializedResponseWriter, TestFieldCacheSort, LukeRequestHandlerTest, TestSolrCloudWithHadoopAuthPlugin, ZkCLITest, TestUniqueKeyFieldResource, TestFuzzyAnalyzedSuggestions, TestFilteredDocIdSet, TestStressUserVersions, FieldMutatingUpdateProcessorTest, AssignBackwardCompatibilityTest, TestJsonFacetsWithNestedObjects, JWTAuthPluginIntegrationTest, TestCustomSort, NumericFieldsTest, CollectionStateFormat2Test, TestLMDirichletSimilarityFactory, TimeZoneUtilsTest, TestHdfsCloudBackupRestore, TestMergePolicyConfig, TestInPlaceUpdatesStandalone, TestCloudSearcherWarming, CdcrBootstrapTest, OutputWriterTest, LeaderElectionContextKeyTest, TestSolrCoreParser, TestCloudInspectUtil, DeleteStatusTest, SolrGraphiteReporterTest, DistanceFunctionTest, CoreAdminHandlerTest, SpatialHeatmapFacetsTest, SuggestComponentContextFilterQueryTest, TestCloudSchemaless, TestNumericTokenStream, CollectionsAPIAsyncDistributedZkTest, TestFieldTypeResource, AutoScalingHandlerTest, DirectSolrSpellCheckerTest, TestDocTermOrdsUninvertLimit, TestFastOutputStream, RecoveryZkTest, FileUtilsTest, SolrCoreTest, ResponseBuilderTest, AtomicUpdateProcessorFactoryTest, TestTrieFacet, DOMUtilTest, TestBlendedInfixSuggestions, TestSolrQueryParser, TestRTGBase, CurrencyFieldTypeTest, TestComplexPhraseLeadingWildcard, TestMinMaxOnMultiValuedField, TestSchemaManager, TestCSVLoader, TestSubQueryTransformerCrossCore, EmbeddedSolrNoSerializeTest, LeaderVoteWaitTimeoutTest, SpellCheckCollatorTest, TestAuthenticationFramework, TestLegacyNumericRangeQueryBuilder, SpellingQueryConverterTest, TestHalfAndHalfDocValues, TestLeaderElectionWithEmptyReplica, TestSlowCompositeReaderWrapper, CheckHdfsIndexTest, TestClusterStateMutator, PhrasesIdentificationComponentTest, TestTrackingShardHandlerFactory, TestRawTransformer, TestHdfsBackupRestoreCore, ByteBuffersDirectoryFactoryTest, PreAnalyzedFieldManagedSchemaCloudTest, SegmentsInfoRequestHandlerTest, TestMissingGroups, SpatialFilterTest, TestSimpleTextCodec, TestSha256AuthenticationProvider, TestLRUStatsCache, TestCloudPseudoReturnFields, ShardRoutingCustomTest, PeerSyncTest, DebugComponentTest, BasicDistributedZkTest, TestSSLRandomization, TestSchemaSimilarityResource, UniqFieldsUpdateProcessorFactoryTest, TestStressInPlaceUpdates, SolrIndexMetricsTest, OverseerTest, TestScoreJoinQPScore, QueryEqualityTest, TestConfigSetsAPIExclusivity, TestSolrCloudWithKerberosAlt, PeerSyncWithLeaderAndIndexFingerprintCachingTest, TestInitQParser, AnalysisErrorHandlingTest, TestDocumentBuilder, TestManagedSynonymGraphFilterFactory, DocValuesNotIndexedTest, TriLevelCompositeIdRoutingTest, ImplicitSnitchTest, TestQuerySenderNoQuery, TestInitParams, SimpleMLTQParserTest, TestMacros, TestTolerantUpdateProcessorCloud, TermVectorComponentTest, HealthCheckHandlerTest, CoreMergeIndexesAdminHandlerTest, DocumentAnalysisRequestHandlerTest, TestTrie, TestUnInvertedFieldException, TestCustomStream, HdfsDirectoryFactoryTest, TestSmileRequest, TestPullReplica, TestCoreContainer, TestRTimerTree, SolrSlf4jReporterTest, TestSimpleTrackingShardHandler, OverriddenZkACLAndCredentialsProvidersTest, ScheduledTriggerIntegrationTest, TestLegacyFieldReuse, TestExtendedDismaxParser, SuggesterFSTTest, AnalysisAfterCoreReloadTest, BasicFunctionalityTest, ConvertedLegacyTest, CursorPagingTest, DistributedIntervalFacetingTest, TestGroupingSearch, PathHierarchyTokenizerFactoryTest, ProtectedTermFilterFactoryTest, TestCharFilters, TestDeprecatedFilters, TestReversedWildcardFilterFactory, TokenizerChainTest, TestLuceneIndexBackCompat, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ActionThrottleTest, ChaosMonkeyNothingIsSafeTest, CleanupOldIndexTest, ConcurrentCreateRoutedAliasTest, ConfigSetsAPITest, ConnectionManagerTest, CreateCollectionCleanupTest, CreateRoutedAliasTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, MoveReplicaHDFSFailoverTest, MoveReplicaHDFSTest, MoveReplicaTest, MultiSolrCloudTestCaseTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, ShardRoutingTest, SolrXmlInZkTest, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestLockTree, TestMiniSolrCloudClusterSSL, TestPullReplicaErrorHandling, TestSegmentSorting, TestUtilizeNode, ZkControllerTest, ZkFailoverTest, ZkNodePropsTest, ZkShardTermsTest, ZkSolrClientTest, ConcurrentDeleteAndCreateCollectionTest, CustomCollectionTest, HdfsCollectionsAPIDistributedZkTest, ShardSplitTest, IndexSizeTriggerTest, MetricTriggerTest, NodeAddedTriggerIntegrationTest, NodeAddedTriggerTest, NodeMarkersRegistrationTest]
[junit4] Completed [548/843 (1!)] on J2 in 36.77s, 1 test, 1 failure <<< FAILURES!
[...truncated 1060 lines...]
[junit4] ERROR: JVM J1 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-9.0.4/bin/java -XX:-UseCompressedOops -XX:+UseSerialGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps -ea -esa --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=A432A932DA0EDD7 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=9.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/solr-tests.policy -Dtests.LUCENE_VERSION=9.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-master-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp -Djunit4.childvm.id=1 -Djunit4.childvm.count=3 -Dfile.encoding=US-ASCII -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=false -classpath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/junit4-ant-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/lucene-analyzers-common-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/nori/lucene-analyzers-nori-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/lucene-codecs-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/lucene-backward-codecs-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/lucene-highlighter-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/lucene-memory-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/lucene-misc-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/lucene-spatial-extras-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/lucene-spatial3d-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/lucene-expressions-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/lucene-suggest-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/lucene-grouping-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/lucene-queries-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/lucene-queryparser-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/lucene-join-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/lucene-sandbox-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/lucene-classification-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-5.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-commons-5.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/avatica-core-1.10.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/caffeine-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/calcite-core-1.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/calcite-linq4j-1.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-beanutils-1.9.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-cli-1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-codec-1.11.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-collections-3.2.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-compiler-2.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-configuration2-2.1.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-exec-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-fileupload-1.3.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-io-2.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-lang-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-lang3-3.8.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-client-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-framework-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-recipes-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/disruptor-3.4.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/dom4j-1.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/eigenbase-properties-1.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/guava-14.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-annotations-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-auth-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-common-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-hdfs-client-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hppc-0.8.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/htrace-core4-4.1.0-incubating.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-annotations-2.9.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-core-2.9.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-databind-2.9.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-dataformat-smile-2.9.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/janino-2.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jose4j-0.6.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerb-core-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerb-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerby-asn1-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerby-pkix-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-1.2-api-2.11.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-api-2.11.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-core-2.11.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-slf4j-impl-2.11.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet-2.3.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/protobuf-java-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/re2j-1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/rrd4j-3.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/spatial4j-0.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/t-digest-3.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-io-2.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-client-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-common-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-hpack-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-http-client-transport-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpclient-4.5.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpcore-4.4.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpmime-4.5.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-alpn-client-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-alpn-java-client-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-client-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-http-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-io-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-util-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/noggit-0.8.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/slf4j-api-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/stax2-api-3.1.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/zookeeper-3.4.13.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/gmetric4j-1.0.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-common-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-hpack-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-server-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/javax.servlet-api-3.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-alpn-java-server-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-alpn-server-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-continuation-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-deploy-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-http-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-io-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-jmx-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-rewrite-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-security-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-server-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlet-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlets-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-util-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-webapp-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-xml-9.4.14.v20181114.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-core-3.2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-ganglia-3.2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-graphite-3.2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jetty9-3.2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jvm-3.2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/byte-buddy-1.9.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-logging-1.1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-text-1.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-common-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-minicluster-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-minikdc-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/jersey-core-1.19.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/jersey-server-1.19.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/jersey-servlet-1.19.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-admin-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-client-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-common-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-crypto-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-identity-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-server-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-simplekdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-config-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-kdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/mockito-core-2.23.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/netty-all-4.0.52.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/objenesis-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/lucene-analyzers-icu-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analysis-extras/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/contrib/analysis-extras/lib/icu4j-62.1.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/home/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.2.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20190207_080025_61016518546168103083666.events @/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20190207_080025_6103929559174710718376.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20190207_080025_6107622820522814555458.sysout
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
[junit4] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] at java.base/java.lang.Thread.run(Thread.java:844)
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:633: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:577: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:267: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/common-build.xml:558: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1572: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1099: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20190207_080025_6107622820522814555458.sysout
Total time: 65 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2