You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/07/19 10:24:19 UTC
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 732 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/732/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost
Error Message:
Error from server at http://127.0.0.1:46450/solr: create the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46450/solr: create the collection time out:180s
at __randomizedtesting.SeedInfo.seed([E75105577775B87C:D791E4D5FF075920]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost(ComputePlanActionTest.java:269)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 14150 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/init-core-data-001
[junit4] 2> 2774869 WARN (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=30 numCloses=30
[junit4] 2> 2774869 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2774870 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2774870 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2774871 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/tempDir-001
[junit4] 2> 2774871 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2774875 INFO (Thread-7101) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2774875 INFO (Thread-7101) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2774877 ERROR (Thread-7101) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2774972 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:57147
[junit4] 2> 2774983 INFO (zkConnectionManagerCallback-8707-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2775023 INFO (jetty-launcher-8704-thread-1) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 2775024 INFO (jetty-launcher-8704-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2775024 INFO (jetty-launcher-8704-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2775024 INFO (jetty-launcher-8704-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2775024 INFO (jetty-launcher-8704-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7dbc915d{/solr,null,AVAILABLE}
[junit4] 2> 2775025 INFO (jetty-launcher-8704-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3f39f46f{HTTP/1.1,[http/1.1]}{127.0.0.1:36679}
[junit4] 2> 2775025 INFO (jetty-launcher-8704-thread-1) [ ] o.e.j.s.Server Started @2776547ms
[junit4] 2> 2775025 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36679}
[junit4] 2> 2775031 ERROR (jetty-launcher-8704-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2775032 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2775032 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 2775032 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2775032 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2775032 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-19T09:43:08.681Z
[junit4] 2> 2775040 INFO (zkConnectionManagerCallback-8709-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2775051 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2776211 INFO (jetty-launcher-8704-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57147/solr
[junit4] 2> 2776225 INFO (zkConnectionManagerCallback-8713-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2776231 INFO (zkConnectionManagerCallback-8715-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2776604 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36679_solr
[junit4] 2> 2776606 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.c.Overseer Overseer (id=72533543368458243-127.0.0.1:36679_solr-n_0000000000) starting
[junit4] 2> 2776645 INFO (zkConnectionManagerCallback-8722-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2776658 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57147/solr ready
[junit4] 2> 2776661 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36679_solr
[junit4] 2> 2776661 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 2776661 INFO (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:36679_solr
[junit4] 2> 2776663 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 2776663 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 2776663 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 2776671 INFO (zkCallback-8721-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2776671 INFO (zkCallback-8714-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2776686 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:36679_solr]
[junit4] 2> 2776686 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2776687 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 2776690 DEBUG (ScheduledTrigger-10763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2776721 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2776755 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36679.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2776768 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36679.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2776768 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36679.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2776769 INFO (jetty-launcher-8704-thread-1) [n:127.0.0.1:36679_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/tempDir-001/node1/.
[junit4] 2> 2776821 INFO (zkConnectionManagerCallback-8725-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2776831 INFO (zkConnectionManagerCallback-8730-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2776856 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2776862 INFO (SUITE-ComputePlanActionTest-seed#[E75105577775B87C]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57147/solr ready
[junit4] 2> 2777124 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAdded
[junit4] 2> 2777129 DEBUG (zkCallback-8721-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 2777129 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 2777135 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2777147 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2777148 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2777151 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 2777152 INFO (qtp2080501275-31604) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=3
[junit4] 2> 2777152 DEBUG (qtp2080501275-31609) [n:127.0.0.1:36679_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2777154 INFO (qtp2080501275-31609) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 2777155 DEBUG (zkCallback-8721-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 2777155 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 2777155 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2777156 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2777156 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 2777157 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2777157 DEBUG (qtp2080501275-31608) [n:127.0.0.1:36679_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2777158 INFO (qtp2080501275-31608) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 2777159 DEBUG (zkCallback-8721-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 2777159 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 2777159 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2777160 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2777167 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 2777182 INFO (qtp2080501275-31608) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2777182 DEBUG (qtp2080501275-31607) [n:127.0.0.1:36679_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2777185 DEBUG (zkCallback-8721-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 2777185 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 2777188 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 2777191 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2777191 DEBUG (qtp2080501275-31611) [n:127.0.0.1:36679_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2777192 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 2777193 INFO (qtp2080501275-31608) [n:127.0.0.1:36679_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&name=testNodeAdded&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2777193 DEBUG (zkCallback-8721-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 2777193 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial livenodes: [127.0.0.1:36679_solr]
[junit4] 2> 2777193 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, class=solr.ComputePlanAction}, {name=test, class=org.apache.solr.cloud.autoscaling.ComputePlanActionTest$AssertingTriggerAction}], enabled=true}
[junit4] 2> 2777194 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2777194 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 5
[junit4] 2> 2777195 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 2777196 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2777196 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2777196 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 2777196 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 2777197 INFO (OverseerThreadFactory-10765-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection testNodeAdded
[junit4] 2> 2777198 WARN (OverseerThreadFactory-10765-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 2 on collection testNodeAdded is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 2777201 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2777202 INFO (OverseerThreadFactory-10765-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 7262412765 sessionWrapper.createTime 7262412764818307, this.sessionWrapper.createTime 7262412764818307
[junit4] 2> 2777208 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"testNodeAdded",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 2777208 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeAdded
[junit4] 2> 2777210 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/testNodeAdded/state.json
[junit4] 2> 2777333 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 2777333 INFO (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2777337 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 2777337 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2777340 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 2777340 INFO (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2777342 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2777342 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2777445 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 0
[junit4] 2> 2777553 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2777553 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2777563 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2777563 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"}
[junit4] 2> 2777563 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeAdded_shard1_replica_n2","base_url":"http://127.0.0.1:36679/solr","node_name":"127.0.0.1:36679_solr","state":"down","type":"NRT","force_set_state":"false"}
[junit4] 2> 2777563 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"}}}}}
[junit4] 2> 2777570 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2777583 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2777583 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"}
[junit4] 2> 2777584 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeAdded_shard1_replica_n1","base_url":"http://127.0.0.1:36679/solr","node_name":"127.0.0.1:36679_solr","state":"down","type":"NRT","force_set_state":"false"}
[junit4] 2> 2777584 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"}}}}}
[junit4] 2> 2777688 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 1
[junit4] 2> 2778198 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2778198 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 2778585 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2778599 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.IndexSchema [testNodeAdded_shard1_replica_n2] Schema name=minimal
[junit4] 2> 2778602 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2778602 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testNodeAdded_shard1_replica_n2' using configuration from collection testNodeAdded, trusted=true
[junit4] 2> 2778602 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36679.solr.core.testNodeAdded.shard1.replica_n2' (registry 'solr.core.testNodeAdded.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2778602 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2778602 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrCore [[testNodeAdded_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/tempDir-001/node1/testNodeAdded_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/tempDir-001/node1/./testNodeAdded_shard1_replica_n2/data/]
[junit4] 2> 2778611 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2778622 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.IndexSchema [testNodeAdded_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2778624 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2778624 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testNodeAdded_shard1_replica_n1' using configuration from collection testNodeAdded, trusted=true
[junit4] 2> 2778625 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36679.solr.core.testNodeAdded.shard1.replica_n1' (registry 'solr.core.testNodeAdded.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2778625 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2778625 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrCore [[testNodeAdded_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/tempDir-001/node1/testNodeAdded_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/tempDir-001/node1/./testNodeAdded_shard1_replica_n1/data/]
[junit4] 2> 2778722 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2778722 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2778724 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2778724 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2778726 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2311dd3c[testNodeAdded_shard1_replica_n1] main]
[junit4] 2> 2778733 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2778733 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2778734 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2778734 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2778736 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@76cb6e95[testNodeAdded_shard1_replica_n2] main]
[junit4] 2> 2778744 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2778744 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2778745 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2778745 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2778745 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2778746 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2778746 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606411503423979520
[junit4] 2> 2778746 INFO (searcherExecutor-10771-thread-1-processing-n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n1 c:testNodeAdded s:shard1 r:core_node3) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrCore [testNodeAdded_shard1_replica_n1] Registered new searcher Searcher@2311dd3c[testNodeAdded_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2778746 INFO (searcherExecutor-10770-thread-1-processing-n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2 c:testNodeAdded s:shard1 r:core_node4) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrCore [testNodeAdded_shard1_replica_n2] Registered new searcher Searcher@76cb6e95[testNodeAdded_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2778746 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606411503423979520
[junit4] 2> 2778763 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testNodeAdded/terms/shard1 to Terms{values={core_node4=0}, version=0}
[junit4] 2> 2778763 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
[junit4] 2> 2778767 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testNodeAdded/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
[junit4] 2> 2778788 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded"} current state version: 0
[junit4] 2> 2778791 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2778791 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2778791 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36679/solr/testNodeAdded_shard1_replica_n2/
[junit4] 2> 2778793 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testNodeAdded_shard1_replica_n2 url=http://127.0.0.1:36679/solr START replicas=[http://127.0.0.1:36679/solr/testNodeAdded_shard1_replica_n1/] nUpdates=100
[junit4] 2> 2778794 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testNodeAdded_shard1_replica_n2 url=http://127.0.0.1:36679/solr DONE. We have no versions. sync failed.
[junit4] 2> 2778803 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.c.S.Request [testNodeAdded_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2778804 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2778804 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2778804 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2778828 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36679/solr/testNodeAdded_shard1_replica_n2/ shard1
[junit4] 2> 2778831 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 2778932 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 2
[junit4] 2> 2778937 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2778940 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2778940 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"}
[junit4] 2> 2778940 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeAdded_shard1_replica_n2","base_url":"http://127.0.0.1:36679/solr","node_name":"127.0.0.1:36679_solr","state":"active","type":"NRT","force_set_state":"false","leader":"true"}
[junit4] 2> 2778940 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/3)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 2778941 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node4 x:testNodeAdded_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1391
[junit4] 2> 2779042 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 3
[junit4] 2> 2779043 INFO (zkCallback-8714-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2779199 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2779199 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 2779796 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2779796 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeAdded",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "operation":"state"}
[junit4] 2> 2779796 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeAdded_shard1_replica_n1","base_url":"http://127.0.0.1:36679/solr","node_name":"127.0.0.1:36679_solr","state":"active","type":"NRT","force_set_state":"false"}
[junit4] 2> 2779796 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 2779797 INFO (qtp2080501275-31611) [n:127.0.0.1:36679_solr c:testNodeAdded s:shard1 r:core_node3 x:testNodeAdded_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeAdded_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeAdded&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2228
[junit4] 2> 2779816 INFO (qtp2080501275-31608) [n:127.0.0.1:36679_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2779897 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeAdded/state.json version: 4
[junit4] 2> 2779897 INFO (zkCallback-8714-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeAdded/state.json] for collection [testNodeAdded] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2780199 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2780200 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 2780817 INFO (qtp2080501275-31608) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&name=testNodeAdded&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3626
[junit4] 2> 2780823 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testNodeAdded.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testNodeAdded.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 2780825 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 2780826 DEBUG (qtp2080501275-31609) [n:127.0.0.1:36679_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2780827 INFO (qtp2080501275-31609) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 2780828 DEBUG (zkCallback-8721-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 2780828 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 2780828 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 2780828 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2780829 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 2780829 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2780829 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2780829 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 2780830 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70d0700c{/solr,null,AVAILABLE}
[junit4] 2> 2780830 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3a6533b0{HTTP/1.1,[http/1.1]}{127.0.0.1:34285}
[junit4] 2> 2780830 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.e.j.s.Server Started @2782356ms
[junit4] 2> 2780830 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34285}
[junit4] 2> 2780830 ERROR (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2780832 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2780832 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 2780832 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2780832 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2780832 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-19T09:43:14.481Z
[junit4] 2> 2780834 INFO (zkConnectionManagerCallback-8734-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2780835 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2781203 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2781203 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 2781211 INFO (OverseerCollectionConfigSetProcessor-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2781269 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57147/solr
[junit4] 2> 2781271 INFO (zkConnectionManagerCallback-8738-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2781276 INFO (zkConnectionManagerCallback-8740-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2781301 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2781320 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2781320 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34285_solr
[junit4] 2> 2781320 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:34285_solr"} current state version: 0
[junit4] 2> 2781320 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:34285_solr
[junit4] 2> 2781322 INFO (zkCallback-8714-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2781322 INFO (zkCallback-8729-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2781322 INFO (zkCallback-8729-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2781322 INFO (zkCallback-8721-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2781322 INFO (zkCallback-8739-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2781391 INFO (zkConnectionManagerCallback-8747-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2781395 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2781396 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57147/solr ready
[junit4] 2> 2781397 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2781420 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34285.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2781430 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34285.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2781430 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34285.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f838f89
[junit4] 2> 2781431 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [n:127.0.0.1:34285_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_E75105577775B87C-001/tempDir-001/node2/.
[junit4] 2> 2782205 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2782205 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 2782205 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:34285_solr at time 7262417770938548
[junit4] 2> 2783207 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2783207 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 2783207 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:34285_solr] added at times [7262417770938548], now=7262418773473495
[junit4] 2> 2783207 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"19cd21677280b4Ta1jwucb95f2hknxgu42als9x4",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":7262417770938548,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[7262417770938548],
[junit4] 2> "nodeNames":["127.0.0.1:34285_solr"]}}
[junit4] 2> 2783210 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_trigger]
[junit4] 2> 2783211 INFO (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 2783211 DEBUG (ScheduledTrigger-10763-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - removing marker path: /autoscaling/nodeAdded/127.0.0.1:34285_solr
[junit4] 2> 2783211 DEBUG (AutoscalingActionExecutor-10764-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"19cd21677280b4Ta1jwucb95f2hknxgu42als9x4",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":7262417770938548,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[7262417770938548],
[junit4] 2> "_enqueue_time_":7262418776440452,
[junit4] 2> "nodeNames":["127.0.0.1:34285_solr"]}}
[junit4] 2> 2783211 DEBUG (AutoscalingActionExecutor-10764-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"19cd21677280b4Ta1jwucb95f2hknxgu42als9x4",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":7262417770938548,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[7262417770938548],
[junit4] 2> "_enqueue_time_":7262418776440452,
[junit4] 2> "nodeNames":["127.0.0.1:34285_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 2783221 INFO (qtp1977462798-31667) [n:127.0.0.1:34285_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2783222 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testNodeAdded.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testNodeAdded.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 2783223 INFO (qtp2080501275-31609) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2783225 INFO (AutoscalingActionExecutor-10764-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testNodeAdded&targetNode=127.0.0.1:34285_solr&inPlaceMove=true&replica=core_node3
[junit4] 2> 2783225 INFO (AutoscalingActionExecutor-10764-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 7262418791 sessionWrapper.createTime 7262418790275940, this.sessionWrapper.createTime 7262418790275940
[junit4] 2> 2783225 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.a.ComputePlanActionTest -------------_ FINAL STATE --------------
[junit4] 2> 2783228 DEBUG (AutoscalingActionExecutor-10764-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 5000ms
[junit4] 2> 2783228 DEBUG (AutoscalingActionExecutor-10764-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 17 ms for event id=19cd21677280b4Ta1jwucb95f2hknxgu42als9x4
[junit4] 2> 2783240 INFO (qtp1977462798-31663) [n:127.0.0.1:34285_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=11
[junit4] 2> 2783240 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.a.ComputePlanActionTest * Node values: 127.0.0.1:34285_solr
[junit4] 2> {
[junit4] 2> "node":"127.0.0.1:34285_solr",
[junit4] 2> "cores":0,
[junit4] 2> "port":"34285",
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "ip_1":"1",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"127",
[junit4] 2> "freedisk":11.717687129974365}
[junit4] 2> 2783248 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2783249 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.a.ComputePlanActionTest * Node values: 127.0.0.1:36679_solr
[junit4] 2> {
[junit4] 2> "node":"127.0.0.1:36679_solr",
[junit4] 2> "cores":2,
[junit4] 2> "port":"36679",
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "ip_1":"1",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"127",
[junit4] 2> "freedisk":11.717687129974365}
[junit4] 2> 2783249 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.a.ComputePlanActionTest * Live nodes: [127.0.0.1:34285_solr, 127.0.0.1:36679_solr]
[junit4] 2> 2783250 DEBUG (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.c.a.ComputePlanActionTest * Collection testNodeAdded state: DocCollection(testNodeAdded//collections/testNodeAdded/state.json/5)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:36679/solr",
[junit4] 2> "node_name":"127.0.0.1:36679_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false",
[junit4] 2> "leader":"true"}}}},
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0"}
[junit4] 2> 2783251 INFO (TEST-ComputePlanActionTest.testNodeAdded-seed#[E75105577775B87C]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAdded
[junit4] 2> 2783543 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSelectedCollections
[junit4] 2> 2783549 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3a6533b0{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2783549 DEBUG (zkCallback-8721-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 2783550 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 2783553 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1298800240
[junit4] 2> 2783554 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2783554 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5c2dc0df: rootName = solr_34285, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4123e812
[junit4] 2> 2783561 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2783562 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2783562 DEBUG (OverseerAutoScalingTriggerThread-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 2783563 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2783563 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@48430b1f: rootName = solr_34285, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5cd0a009
[junit4] 2> 2783568 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2783568 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76f24c22: rootName = solr_34285, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@350e4966
[junit4] 2> 2783570 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34285_solr
[junit4] 2> 2783572 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2783572 INFO (zkCallback-8746-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2783573 INFO (zkCallback-8729-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2783573 INFO (zkCallback-8739-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2783573 INFO (zkCallback-8714-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2783573 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:34285_solr"} current state version: 0
[junit4] 2> 2783573 DEBUG (OverseerStateUpdate-72533543368458243-127.0.0.1:36679_solr-n_0000000000) [ ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:34285_solr
[junit4] 2> 2783573 INFO (zkCallback-8729-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2783574 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101b0df96c7000a, likely client has closed socket
[junit4] 2> 2783575 INFO (zkCallback-8721-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2783579 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@70d0700c{/solr,null,UNAVAILABLE}
[junit4] 2> 2783579 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 2783583 INFO (TEST-ComputePlanActionTest.testSelectedCollections-seed#[E75105577775B87C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2783589 INFO (qtp2080501275-31609) [n:127.0.0.1:36679_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testNodeAdded&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2783592 INFO (OverseerThreadFactory-10765-thread-2) [ ] o.a.s.c.a.c.OverseerCollectionMessageHandler Executing Collection Cmd=action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true&deleteMetricsHistory=true, asyncId=null
[junit4] 2> 2783595 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeAdded.shard1.replica_n2, tag=null
[junit4] 2> 2783595 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60061b0f: rootName = solr_36679, domain = solr.core.testNodeAdded.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testNodeAdded.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@3ea9628e
[junit4] 2> 2783603 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeAdded.shard1.replica_n1, tag=null
[junit4] 2> 2783603 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.c.SolrCore [testNodeAdded_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@57e27925
[junit4] 2> 2783603 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@64020803: rootName = solr_36679, domain = solr.core.testNodeAdded.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testNodeAdded.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@438c4d25
[junit4] 2> 2783617 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n1] o.a.s.c.SolrCore [testNodeAdded_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@a808469
[junit4] 2> 2783617 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeAdded.shard1.replica_n2, tag=57e27925
[junit4] 2> 2783618 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeAdded.shard1.leader, tag=57e27925
[junit4] 2> 2783618 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeAdded.shard1.replica_n1, tag=a808469
[junit4] 2> 2783618 INFO (qtp2080501275-31607) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeAdded.shard1.leader, tag=a808469
[junit4] 2> 2783620 INFO (qtp2080501275-31606) [n:127.0.0.1:36679_solr x:testNodeAdded_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testNodeAdded/terms/shard1 to Terms{values={core_node3=0}, version=2}
[junit4] 2> 2783622 WARN (zkCallback-8714-thread-1) [ ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not found:testNodeAdded_shard1_replica_n1 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:312) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:270) ~[java/:?]
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_172]
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_172]
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[java/:?]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_172]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_172]
[junit4] 2> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
[
[...truncated too long message...]
s.xml
install-junit4-taskdef:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 14ms :: artifacts dl 1ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 1 | 0 | 0 | 0 || 1 | 0 |
---------------------------------------------------------------------
-init-totals:
-test:
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: E75105577775B87C
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/temp
[junit4] <JUnit4> says 你好! Master seed: E75105577775B87C
[junit4] Executing 5 suites with 2 JVMs.
[junit4]
[junit4] Started J0 PID(20158@serv1-vm3).
[junit4] Started J1 PID(20157@serv1-vm3).
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] OK 7.62s J1 | ComputePlanActionTest.testNodeAdded
[junit4] OK 15.7s J1 | ComputePlanActionTest.testSelectedCollections
[junit4] OK 18.7s J1 | ComputePlanActionTest.testNodeLost
[junit4] OK 7.05s J1 | ComputePlanActionTest.testNodeWithMultipleReplicasLost
[junit4] Completed [1/5] on J1 in 54.79s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] OK 6.70s J0 | ComputePlanActionTest.testNodeAdded
[junit4] OK 17.1s J0 | ComputePlanActionTest.testSelectedCollections
[junit4] OK 18.5s J0 | ComputePlanActionTest.testNodeLost
[junit4] OK 8.80s J0 | ComputePlanActionTest.testNodeWithMultipleReplicasLost
[junit4] Completed [2/5] on J0 in 59.06s, 4 tests
[junit4]
[junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.autoscaling.ComputePlanActionTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] OK 5.08s J1 | ComputePlanActionTest.testNodeAdded
[junit4] OK 15.4s J1 | ComputePlanActionTest.testSelectedCollections
[junit4] OK 18.9s J1 | ComputePlanActionTest.testNodeLost
[junit4] OK 8.09s J1 | ComputePlanActionTest.testNodeWithMultipleReplicasLost
[junit4] Completed [3/5] on J1 in 50.97s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] OK 6.08s J0 | ComputePlanActionTest.testNodeAdded
[junit4] OK 15.9s J0 | ComputePlanActionTest.testSelectedCollections
[junit4] OK 17.4s J0 | ComputePlanActionTest.testNodeLost
[junit4] OK 7.32s J0 | ComputePlanActionTest.testNodeWithMultipleReplicasLost
[junit4] Completed [4/5] on J0 in 50.20s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] OK 6.07s J1 | ComputePlanActionTest.testNodeAdded
[junit4] OK 15.7s J1 | ComputePlanActionTest.testSelectedCollections
[junit4] OK 19.6s J1 | ComputePlanActionTest.testNodeLost
[junit4] OK 8.01s J1 | ComputePlanActionTest.testNodeWithMultipleReplicasLost
[junit4] Completed [5/5] on J1 in 52.96s, 4 tests
[junit4]
[junit4] JVM J0: 0.69 .. 110.88 = 110.20s
[junit4] JVM J1: 0.69 .. 160.66 = 159.98s
[junit4] Execution time total: 2 minutes 40 seconds
[junit4] Tests summary: 5 suites, 20 tests
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp])
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp])
[echo] 5 slowest tests:
[junit4:tophints] 210.21s | org.apache.solr.update.TestInPlaceUpdatesDistrib
[junit4:tophints] 116.92s | org.apache.solr.update.SoftAutoCommitTest
[junit4:tophints] 116.69s | org.apache.solr.cloud.ZkFailoverTest
[junit4:tophints] 112.01s | org.apache.solr.cloud.TestTlogReplica
[junit4:tophints] 99.01s | org.apache.solr.cloud.TestPullReplica
-check-totals:
test-nocompile:
BUILD SUCCESSFUL
Total time: 2 minutes 43 seconds
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2843)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2722)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2703)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3082)
Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
at hudson.remoting.Channel.call(Channel.java:955)
at hudson.FilePath.act(FilePath.java:1089)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084)
at hudson.remoting.UserRequest.perform(UserRequest.java:212)
at hudson.remoting.UserRequest.perform(UserRequest.java:54)
at hudson.remoting.Request$2.run(Request.java:369)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath.act(FilePath.java:1091)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=2cb716952054132a2c267285063658681a9116bb, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #731
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 736 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/736/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
at __randomizedtesting.SeedInfo.seed([A06517146B29FA05:7FE875AB5540AF67]:0)
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2704)
at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Caused by: java.lang.RuntimeException: Exception during query
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2696)
... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1805)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
... 9 more
Build Log:
[...truncated 14391 lines...]
[junit4] Suite: org.apache.solr.handler.component.InfixSuggestersTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001
[junit4] 2> 3668895 WARN (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
[junit4] 2> 3668895 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 3668897 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 3668897 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 3668898 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 3668898 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3668943 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3668955 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=test
[junit4] 2> 3669063 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3670421 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3670421 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 3670439 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3670447 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3670448 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3670450 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3670477 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3670485 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3670571 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3670578 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 3670579 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3670579 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3670579 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001/]
[junit4] 2> 3670581 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=24.9755859375, floorSegmentMB=1.330078125, forceMergeDeletesPctAllowed=19.889221638037927, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=44.61630805930888
[junit4] 2> 3670699 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3670700 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3670701 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=30, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 3670701 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3de38854[collection1] main]
[junit4] 2> 3670702 WARN (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 3670702 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3670702 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3670723 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3670724 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3670724 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3670724 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3670724 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3670724 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3670724 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3670724 INFO (coreLoadExecutor-13015-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3670725 INFO (searcherExecutor-13016-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3de38854[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3670726 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 3670752 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAnalyzingInfixSuggesterBuildThenReload
[junit4] 2> 3670752 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3670752 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
[junit4] 2> 3670766 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
[junit4] 2> 3670815 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3670816 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=63
[junit4] 2> 3670818 ERROR (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 3670821 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3670940 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3670949 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3671023 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3671033 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 3671062 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3671062 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001/]
[junit4] 2> 3671114 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3671115 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3671116 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@229b91f2[collection1] main]
[junit4] 2> 3671116 WARN (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 3671116 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3671116 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671117 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671118 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3671118 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671118 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671118 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3671118 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3671118 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3671118 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3671121 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=16.3310546875, floorSegmentMB=0.44921875, forceMergeDeletesPctAllowed=3.7260836329604197, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=42.34729215813476
[junit4] 2> 3671124 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 3671124 INFO (searcherExecutor-13020-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@229b91f2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3671124 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@926ad26[collection1] main]
[junit4] 2> 3671125 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@35ddfadd
[junit4] 2> 3671125 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=35ddfadd
[junit4] 2> 3671125 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6efcee70: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@6318aae7
[junit4] 2> 3671125 INFO (searcherExecutor-13020-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@926ad26[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3671131 INFO (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testAnalyzingInfixSuggesterBuildThenReload
[junit4] 2> 3671155 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testShutdownDuringBuild
[junit4] 2> 3671157 INFO (AnalyzingInfixSuggesterTest-9513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_long_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3671157 INFO (AnalyzingInfixSuggesterTest-9513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(longRandomAnalyzingInfixSuggester)
[junit4] 2> 3671210 INFO (AnalyzingInfixSuggesterTest-9513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.longRandomAnalyzingInfixSuggester emitted 1000 items.
[junit4] 2> 3671265 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1416257975
[junit4] 2> 3671265 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 3671265 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@65223e65: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@18211ba3
[junit4] 2> 3671273 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 3671273 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3e90c6ad: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7cc8f785
[junit4] 2> 3671274 INFO (AnalyzingInfixSuggesterTest-9513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.longRandomAnalyzingInfixSuggester emitted 2000 items.
[junit4] 2> 3671277 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 3671277 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@41f01d84: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@56fca26
[junit4] 2> 3671277 INFO (coreCloseExecutor-13024-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2ddd8e05
[junit4] 2> 3671277 INFO (coreCloseExecutor-13024-thread-1-processing-x:collection1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=2ddd8e05
[junit4] 2> 3671277 INFO (coreCloseExecutor-13024-thread-1-processing-x:collection1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@67a135bb: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@6318aae7
[junit4] 2> 3671354 ERROR (AnalyzingInfixSuggesterTest-9513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: qt=/suggest_analyzing_infix_long_dictionary&suggest.buildAll=true&wt=xml:org.apache.solr.common.SolrException: SolrCoreState already closed.
[junit4] 2> at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
[junit4] 2> at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
[junit4] 2> at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
[junit4] 2> at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1805)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
[junit4] 2> at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
[junit4] 2> at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
[junit4] 2> at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2696)
[junit4] 2> at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 3671355 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 3671355 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3671376 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3671384 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema [null] Schema name=test
[junit4] 2> 3671454 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3671711 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3671711 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 3671726 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3671732 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3671746 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3671748 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3671793 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3671801 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3671882 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3671890 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 3671890 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3671890 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3671890 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001/]
[junit4] 2> 3671939 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3671939 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3671940 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=24.9755859375, floorSegmentMB=1.330078125, forceMergeDeletesPctAllowed=19.889221638037927, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=44.61630805930888
[junit4] 2> 3671940 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@35da2929[collection1] main]
[junit4] 2> 3671941 WARN (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 3671941 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3671941 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671942 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671942 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3671942 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671943 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3671943 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3671943 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3671944 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3671944 INFO (coreLoadExecutor-13034-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3671945 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 3671945 INFO (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testShutdownDuringBuild
[junit4] 2> 3671951 INFO (searcherExecutor-13035-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@35da2929[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=InfixSuggestersTest -Dtests.method=testShutdownDuringBuild -Dtests.seed=A06517146B29FA05 -Dtests.slow=true -Dtests.locale=pl-PL -Dtests.timezone=Australia/Yancowinna -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.82s J1 | InfixSuggestersTest.testShutdownDuringBuild <<<
[junit4] > Throwable #1: java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
[junit4] > at __randomizedtesting.SeedInfo.seed([A06517146B29FA05:7FE875AB5540AF67]:0)
[junit4] > at java.util.concurrent.FutureTask.report(FutureTask.java:122)
[junit4] > at java.util.concurrent.FutureTask.get(FutureTask.java:192)
[junit4] > at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
[junit4] > at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2704)
[junit4] > at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
[junit4] > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > ... 1 more
[junit4] > Caused by: java.lang.RuntimeException: Exception during query
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
[junit4] > at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
[junit4] > at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2696)
[junit4] > ... 6 more
[junit4] > Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
[junit4] > at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
[junit4] > at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
[junit4] > at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
[junit4] > at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1805)
[junit4] > at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
[junit4] > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
[junit4] > at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
[junit4] > at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
[junit4] > ... 9 more
[junit4] 2> 3671980 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Starting test2xBuildReload
[junit4] 2> 3671980 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3671980 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
[junit4] 2> 3671986 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
[junit4] 2> 3672082 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3672082 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=102
[junit4] 2> 3672082 ERROR (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 3672086 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3672114 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3672135 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3672218 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3672225 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 3672248 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3672248 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001/]
[junit4] 2> 3672312 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3672312 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3672314 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@78e84149[collection1] main]
[junit4] 2> 3672314 WARN (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 3672314 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3672314 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672315 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672315 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3672315 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672316 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672316 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3672316 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3672316 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3672317 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3672320 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7396639194027849]
[junit4] 2> 3672323 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 3672323 INFO (searcherExecutor-13039-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@78e84149[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3672323 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a73e487[collection1] main]
[junit4] 2> 3672324 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6689e5ff
[junit4] 2> 3672324 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=6689e5ff
[junit4] 2> 3672324 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3b92847c: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@67cfaa28
[junit4] 2> 3672324 INFO (searcherExecutor-13039-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1a73e487[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3672331 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3672331 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
[junit4] 2> 3672335 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
[junit4] 2> 3672364 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3672365 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=34
[junit4] 2> 3672365 ERROR (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 3672365 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3672389 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3672462 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3672561 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3672568 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 3672590 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3672590 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001/]
[junit4] 2> 3672657 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3672657 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3672664 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@693f3f17[collection1] main]
[junit4] 2> 3672664 WARN (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 3672665 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3672665 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672666 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672666 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3672666 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672667 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3672667 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3672667 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3672668 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3672668 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3672669 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 3672669 INFO (searcherExecutor-13043-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@693f3f17[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3672669 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 3672669 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@63323fab[collection1] main]
[junit4] 2> 3672670 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7ca60019
[junit4] 2> 3672670 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=7ca60019
[junit4] 2> 3672670 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@395b4f1b: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@67cfaa28
[junit4] 2> 3672670 INFO (searcherExecutor-13043-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@63323fab[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3672681 INFO (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending test2xBuildReload
[junit4] 2> 3672709 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testTwoSuggestersBuildThenReload
[junit4] 2> 3672709 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3672709 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
[junit4] 2> 3672716 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
[junit4] 2> 3672747 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
[junit4] 2> 3672747 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=38
[junit4] 2> 3672747 ERROR (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 3672748 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3672794 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3672818 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3672906 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3672914 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 3672938 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3672938 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001/]
[junit4] 2> 3672996 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3672996 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3672999 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7b92aabf[collection1] main]
[junit4] 2> 3672999 WARN (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 3672999 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3672999 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673001 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673001 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3673001 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673002 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673002 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3673002 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3673003 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3673003 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3673003 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=60.1552734375, floorSegmentMB=0.337890625, forceMergeDeletesPctAllowed=4.372294251070848, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1698138514636142, deletesPctAllowed=21.494791027424185
[junit4] 2> 3673004 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 3673004 INFO (searcherExecutor-13047-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7b92aabf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3673004 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1dc2c6a0[collection1] main]
[junit4] 2> 3673005 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@101b82bf
[junit4] 2> 3673005 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=101b82bf
[junit4] 2> 3673005 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2dc75068: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@67cfaa28
[junit4] 2> 3673006 INFO (searcherExecutor-13047-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1dc2c6a0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3673016 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_blended_infix_short_dictionary&suggest.onlyMorePopular=true&indent=off&suggest.count=10&suggest=true&suggest.collate=true&suggest.buildAll=true&suggest.dictionary=shortRandomBlendedInfixSuggester&wt=xml
[junit4] 2> 3673016 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomBlendedInfixSuggester)
[junit4] 2> 3673053 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomBlendedInfixSuggester disabled after emitting 100 items.
[junit4] 2> 3673109 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_blended_infix_short_dictionary&suggest.onlyMorePopular=true&indent=off&suggest.count=10&suggest=true&suggest.collate=true&suggest.buildAll=true&suggest.dictionary=shortRandomBlendedInfixSuggester&wt=xml
[junit4] 2> 3673109 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/suggest_blended_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=93
[junit4] 2> 3673114 ERROR (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 3673114 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3673142 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 3673167 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3673253 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3673262 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 3673300 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6729f28e
[junit4] 2> 3673300 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001/init-core-data-001/]
[junit4] 2> 3673371 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3673371 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3673373 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@32e42c1c[collection1] main]
[junit4] 2> 3673373 WARN (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 3673373 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3673373 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673374 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673374 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3673374 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673375 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
[junit4] 2> 3673375 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 3673375 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3673376 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
[junit4] 2> 3673376 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3673376 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=4.4755859375, floorSegmentMB=1.7939453125, forceMergeDeletesPctAllowed=26.980159261524552, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14150949687747325, deletesPctAllowed=40.86015217206485
[junit4] 2> 3673377 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 3673377 INFO (searcherExecutor-13051-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@32e42c1c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3673377 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3854066f[collection1] main]
[junit4] 2> 3673377 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@47883b05
[junit4] 2> 3673377 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=47883b05
[junit4] 2> 3673377 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6667dfc4: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@67cfaa28
[junit4] 2> 3673378 INFO (searcherExecutor-13051-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3854066f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3673384 INFO (TEST-InfixSuggestersTest.testTwoSuggestersBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testTwoSuggestersBuildThenReload
[junit4] 2> 3673410 INFO (TEST-InfixSuggestersTest.testReloadDuringBuild-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testReloadDuringBuild
[junit4] 2> 3673411 ERROR (TEST-InfixSu
[...truncated too long message...]
[junit4] 2> 16041 INFO (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=936e80c
[junit4] 2> 16041 INFO (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@455cac35: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1c51e412
[junit4] 2> 16050 INFO (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A06517146B29FA05]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testBlendedInfixSuggesterBuildThenReload
[junit4] OK 0.49s J0 | InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload
[junit4] 2> 16051 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 16051 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=973424525
[junit4] 2> 16051 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 16052 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6cb5d04: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@38ee07ca
[junit4] 2> 16052 INFO (searcherExecutor-61-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@72822f48[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 16055 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 16055 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6cb52ea7: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@133f72a7
[junit4] 2> 16055 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 16055 INFO (SUITE-InfixSuggestersTest-seed#[A06517146B29FA05]-worker) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1febc721: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@15e04b9f
[junit4] 2> 16056 INFO (coreCloseExecutor-65-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7804f95
[junit4] 2> 16056 INFO (coreCloseExecutor-65-thread-1-processing-x:collection1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=7804f95
[junit4] 2> 16056 INFO (coreCloseExecutor-65-thread-1-processing-x:collection1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10439e3b: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1c51e412
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.InfixSuggestersTest_A06517146B29FA05-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=pl-PL, timezone=Australia/Yancowinna
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=3,threads=1,free=306089456,total=395313152
[junit4] 2> NOTE: All tests run in this JVM: [InfixSuggestersTest]
[junit4] Completed [1/5 (1!)] on J0 in 15.23s, 7 tests, 1 error <<< FAILURES!
[junit4]
[junit4] Suite: org.apache.solr.handler.component.InfixSuggestersTest
[junit4] OK 1.38s J1 | InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload
[junit4] OK 1.35s J1 | InfixSuggestersTest.testShutdownDuringBuild
[junit4] OK 1.09s J1 | InfixSuggestersTest.test2xBuildReload
[junit4] OK 2.45s J1 | InfixSuggestersTest.testTwoSuggestersBuildThenReload
[junit4] OK 1.24s J1 | InfixSuggestersTest.testReloadDuringBuild
[junit4] OK 1.11s J1 | InfixSuggestersTest.testBuildThen2xReload
[junit4] OK 0.51s J1 | InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload
[junit4] Completed [2/5 (1!)] on J1 in 16.50s, 7 tests
[junit4]
[junit4] Duplicate suite name used with XML reports: org.apache.solr.handler.component.InfixSuggestersTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
[junit4] Suite: org.apache.solr.handler.component.InfixSuggestersTest
[junit4] OK 0.24s J0 | InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload
[junit4] OK 1.28s J0 | InfixSuggestersTest.testShutdownDuringBuild
[junit4] OK 1.00s J0 | InfixSuggestersTest.test2xBuildReload
[junit4] OK 0.65s J0 | InfixSuggestersTest.testTwoSuggestersBuildThenReload
[junit4] OK 0.91s J0 | InfixSuggestersTest.testReloadDuringBuild
[junit4] OK 0.67s J0 | InfixSuggestersTest.testBuildThen2xReload
[junit4] OK 0.59s J0 | InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload
[junit4] Completed [3/5 (1!)] on J0 in 7.29s, 7 tests
[junit4]
[junit4] Suite: org.apache.solr.handler.component.InfixSuggestersTest
[junit4] OK 0.36s J1 | InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload
[junit4] OK 1.11s J1 | InfixSuggestersTest.testShutdownDuringBuild
[junit4] OK 1.07s J1 | InfixSuggestersTest.test2xBuildReload
[junit4] OK 0.82s J1 | InfixSuggestersTest.testTwoSuggestersBuildThenReload
[junit4] OK 1.00s J1 | InfixSuggestersTest.testReloadDuringBuild
[junit4] OK 0.56s J1 | InfixSuggestersTest.testBuildThen2xReload
[junit4] OK 0.45s J1 | InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload
[junit4] Completed [4/5 (1!)] on J1 in 7.93s, 7 tests
[junit4]
[junit4] Suite: org.apache.solr.handler.component.InfixSuggestersTest
[junit4] OK 0.29s J0 | InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload
[junit4] OK 1.22s J0 | InfixSuggestersTest.testShutdownDuringBuild
[junit4] OK 0.57s J0 | InfixSuggestersTest.test2xBuildReload
[junit4] OK 0.44s J0 | InfixSuggestersTest.testTwoSuggestersBuildThenReload
[junit4] OK 0.42s J0 | InfixSuggestersTest.testReloadDuringBuild
[junit4] OK 0.42s J0 | InfixSuggestersTest.testBuildThen2xReload
[junit4] OK 0.21s J0 | InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload
[junit4] Completed [5/5 (1!)] on J0 in 4.89s, 7 tests
[junit4]
[junit4]
[junit4] Tests with failures [seed: A06517146B29FA05]:
[junit4] - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
[junit4]
[junit4]
[junit4] JVM J0: 0.69 .. 28.89 = 28.19s
[junit4] JVM J1: 0.70 .. 25.98 = 25.28s
[junit4] Execution time total: 29 seconds
[junit4] Tests summary: 5 suites, 35 tests, 1 error
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1092: There were test failures: 5 suites, 35 tests, 1 error [seed: A06517146B29FA05]
Total time: 31 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 1/5 failed: org.apache.solr.handler.component.InfixSuggestersTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=b086323f5c46698ed407ec9af1e1f080f76155ac, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #735
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 735 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/735/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:38724/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:59375/solr/MoveReplicaHDFSTest_failed_coll_true]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:38724/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:59375/solr/MoveReplicaHDFSTest_failed_coll_true]
at __randomizedtesting.SeedInfo.seed([7551A846818CF05E:DF9C7BB4365F258E]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:288)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:38724/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
... 46 more
Build Log:
[...truncated 13897 lines...]
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/init-core-data-001
[junit4] 2> 2621090 WARN (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
[junit4] 2> 2621091 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2621092 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2621093 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2621094 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001
[junit4] 2> 2621095 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2621095 INFO (Thread-3691) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2621095 INFO (Thread-3691) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2621097 ERROR (Thread-3691) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2621195 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:48804
[junit4] 2> 2621209 INFO (zkConnectionManagerCallback-7760-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621228 INFO (jetty-launcher-7757-thread-1) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 2621228 INFO (jetty-launcher-7757-thread-3) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 2621228 INFO (jetty-launcher-7757-thread-4) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 2621229 INFO (jetty-launcher-7757-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2621229 INFO (jetty-launcher-7757-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2621229 INFO (jetty-launcher-7757-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 2621229 INFO (jetty-launcher-7757-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16a6e5b5{/solr,null,AVAILABLE}
[junit4] 2> 2621230 INFO (jetty-launcher-7757-thread-2) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 2621231 INFO (jetty-launcher-7757-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2621231 INFO (jetty-launcher-7757-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2621231 INFO (jetty-launcher-7757-thread-4) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 2621232 INFO (jetty-launcher-7757-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2ebe7ee3{/solr,null,AVAILABLE}
[junit4] 2> 2621235 INFO (jetty-launcher-7757-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6f21cafe{SSL,[ssl, http/1.1]}{127.0.0.1:56089}
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-1) [ ] o.e.j.s.Server Started @2622620ms
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56089}
[junit4] 2> 2621236 ERROR (jetty-launcher-7757-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-20T18:09:28.165Z
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2621236 INFO (jetty-launcher-7757-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2621237 INFO (jetty-launcher-7757-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27945af1{/solr,null,AVAILABLE}
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4c0c123{SSL,[ssl, http/1.1]}{127.0.0.1:38724}
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-4) [ ] o.e.j.s.Server Started @2622622ms
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38724}
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2621238 ERROR (jetty-launcher-7757-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2621238 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 2621239 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2621239 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2621239 INFO (jetty-launcher-7757-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f96ffc6{/solr,null,AVAILABLE}
[junit4] 2> 2621239 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-20T18:09:28.168Z
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@42a62745{SSL,[ssl, http/1.1]}{127.0.0.1:35540}
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.e.j.s.Server Started @2622626ms
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35540}
[junit4] 2> 2621242 ERROR (jetty-launcher-7757-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2621242 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-20T18:09:28.171Z
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4c1e4436{SSL,[ssl, http/1.1]}{127.0.0.1:48821}
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.e.j.s.Server Started @2622630ms
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48821}
[junit4] 2> 2621246 ERROR (jetty-launcher-7757-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2621246 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-20T18:09:28.175Z
[junit4] 2> 2621250 INFO (zkConnectionManagerCallback-7762-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621251 INFO (zkConnectionManagerCallback-7764-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621251 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2621252 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2621253 INFO (zkConnectionManagerCallback-7768-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621258 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2621258 INFO (zkConnectionManagerCallback-7766-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621263 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2621263 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101b7d665890001, likely client has closed socket
[junit4] 2> 2621266 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101b7d665890003, likely client has closed socket
[junit4] 2> 2621530 INFO (jetty-launcher-7757-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48804/solr
[junit4] 2> 2621570 INFO (zkConnectionManagerCallback-7772-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621573 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621754 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48821_solr
[junit4] 2> 2621755 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.c.Overseer Overseer (id=72541200469000198-127.0.0.1:48821_solr-n_0000000000) starting
[junit4] 2> 2621765 INFO (zkConnectionManagerCallback-7781-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2621767 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48804/solr ready
[junit4] 2> 2621768 INFO (OverseerStateUpdate-72541200469000198-127.0.0.1:48821_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:48821_solr
[junit4] 2> 2621769 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48821_solr
[junit4] 2> 2621770 INFO (OverseerStateUpdate-72541200469000198-127.0.0.1:48821_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2621797 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2621797 INFO (zkCallback-7780-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2621826 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48821.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2621833 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48821.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2621833 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48821.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2621834 INFO (jetty-launcher-7757-thread-3) [n:127.0.0.1:48821_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node4/.
[junit4] 2> 2622192 INFO (jetty-launcher-7757-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48804/solr
[junit4] 2> 2622194 INFO (zkConnectionManagerCallback-7786-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622197 INFO (zkConnectionManagerCallback-7788-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622205 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2622211 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2622211 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35540_solr
[junit4] 2> 2622212 INFO (zkCallback-7780-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2622213 INFO (zkCallback-7773-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2622240 INFO (zkCallback-7787-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2622241 INFO (zkConnectionManagerCallback-7795-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622242 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2622243 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48804/solr ready
[junit4] 2> 2622243 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2622260 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35540.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2622268 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35540.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2622268 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35540.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2622269 INFO (jetty-launcher-7757-thread-2) [n:127.0.0.1:35540_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node2/.
[junit4] 2> 2622469 INFO (jetty-launcher-7757-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48804/solr
[junit4] 2> 2622471 INFO (zkConnectionManagerCallback-7800-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622474 INFO (zkConnectionManagerCallback-7802-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622486 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2622497 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2622497 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38724_solr
[junit4] 2> 2622499 INFO (zkCallback-7773-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2622499 INFO (zkCallback-7780-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2622500 INFO (zkCallback-7801-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2622500 INFO (zkCallback-7794-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2622505 INFO (zkCallback-7787-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2622538 INFO (zkConnectionManagerCallback-7809-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622539 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2622545 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48804/solr ready
[junit4] 2> 2622546 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2622561 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38724.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2622566 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38724.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2622566 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38724.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2622567 INFO (jetty-launcher-7757-thread-4) [n:127.0.0.1:38724_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node3/.
[junit4] 2> 2622864 INFO (jetty-launcher-7757-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48804/solr
[junit4] 2> 2622886 INFO (zkConnectionManagerCallback-7814-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622892 INFO (zkConnectionManagerCallback-7816-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622912 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2622927 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2622927 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56089_solr
[junit4] 2> 2622929 INFO (zkCallback-7794-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2622929 INFO (zkCallback-7780-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2622929 INFO (zkCallback-7787-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2622929 INFO (zkCallback-7773-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2622932 INFO (zkCallback-7815-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2622932 INFO (zkCallback-7808-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2622933 INFO (zkCallback-7801-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2622974 INFO (zkConnectionManagerCallback-7823-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2622977 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2622980 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48804/solr ready
[junit4] 2> 2622981 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2623040 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56089.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2623048 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56089.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2623049 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56089.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2623050 INFO (jetty-launcher-7757-thread-1) [n:127.0.0.1:56089_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node1/.
[junit4] 2> 2623110 INFO (zkConnectionManagerCallback-7826-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2623123 INFO (zkConnectionManagerCallback-7831-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2623125 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2623126 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48804/solr ready
[junit4] 2> 2623321 INFO (qtp1383850594-26140) [n:127.0.0.1:35540_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2623360 INFO (qtp1383850594-26140) [n:127.0.0.1:35540_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=38
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 2623560 WARN (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 2623639 WARN (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2623646 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2623708 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_serv1.vm3_56669_hdfs____5r4jnd/webapp
[junit4] 2> 2624851 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@serv1-vm3:56669
[junit4] 2> 2625344 WARN (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2625348 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2625352 INFO (OverseerCollectionConfigSetProcessor-72541200469000198-127.0.0.1:48821_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2625376 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_42281_datanode____.pmflm4/webapp
[junit4] 2> 2625955 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42281
[junit4] 2> 2626251 WARN (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2626253 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2626278 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_34294_datanode____.gs0iml/webapp
[junit4] 2> 2626585 ERROR (DataNode: [[[DISK]file:/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to serv1-vm3/127.0.0.1:34093) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 2626687 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1a37647b54601f: from storage DS-77a6d857-4943-4864-99b4-2e1bd099fe0b node DatanodeRegistration(127.0.0.1:56148, datanodeUuid=2f484784-dac4-4f79-bbc4-2aca864953a7, infoPort=55671, infoSecurePort=0, ipcPort=48211, storageInfo=lv=-56;cid=testClusterID;nsid=294907362;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 2626687 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1a37647b54601f: from storage DS-f743c915-4be7-4826-b05c-260a6b69259c node DatanodeRegistration(127.0.0.1:56148, datanodeUuid=2f484784-dac4-4f79-bbc4-2aca864953a7, infoPort=55671, infoSecurePort=0, ipcPort=48211, storageInfo=lv=-56;cid=testClusterID;nsid=294907362;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 2628028 INFO (SUITE-MoveReplicaHDFSTest-seed#[7551A846818CF05E]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34294
[junit4] 2> 2628448 ERROR (DataNode: [[[DISK]file:/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to serv1-vm3/127.0.0.1:34093) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 2628500 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1a3764e824b395: from storage DS-0dcbeca6-5e8c-442d-ba7e-797ccba8b790 node DatanodeRegistration(127.0.0.1:33226, datanodeUuid=6b8a2d47-24fc-46a9-b591-f8bf7afbab22, infoPort=57395, infoSecurePort=0, ipcPort=56119, storageInfo=lv=-56;cid=testClusterID;nsid=294907362;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 2628505 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1a3764e824b395: from storage DS-9a1f0618-d4bb-4bbf-b1f8-f5b4db298ba8 node DatanodeRegistration(127.0.0.1:33226, datanodeUuid=6b8a2d47-24fc-46a9-b591-f8bf7afbab22, infoPort=57395, infoSecurePort=0, ipcPort=56119, storageInfo=lv=-56;cid=testClusterID;nsid=294907362;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 2629989 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNormalFailedMove
[junit4] 2> 2630002 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2630021 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 2630024 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2630024 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2630024 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2630026 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@582f371a{/solr,null,AVAILABLE}
[junit4] 2> 2630026 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@462715b7{SSL,[ssl, http/1.1]}{127.0.0.1:59375}
[junit4] 2> 2630027 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.e.j.s.Server Started @2631415ms
[junit4] 2> 2630027 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59375}
[junit4] 2> 2630036 ERROR (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2630036 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2630036 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 2630037 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2630037 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2630037 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-20T18:09:36.966Z
[junit4] 2> 2630041 INFO (zkConnectionManagerCallback-7835-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2630042 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2631706 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48804/solr
[junit4] 2> 2631708 INFO (zkConnectionManagerCallback-7839-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2631711 INFO (zkConnectionManagerCallback-7841-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2631726 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2631736 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2631736 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59375_solr
[junit4] 2> 2631743 INFO (zkCallback-7830-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631746 INFO (zkCallback-7830-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631746 INFO (zkCallback-7787-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631746 INFO (zkCallback-7822-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631746 INFO (zkCallback-7794-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631746 INFO (zkCallback-7801-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631746 INFO (zkCallback-7780-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631746 INFO (zkCallback-7773-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631747 INFO (zkCallback-7808-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631747 INFO (zkCallback-7815-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631747 INFO (zkCallback-7840-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2631774 INFO (zkConnectionManagerCallback-7848-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2631776 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 2631779 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48804/solr ready
[junit4] 2> 2631779 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2631798 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59375.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2631806 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59375.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2631806 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59375.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2631808 INFO (TEST-MoveReplicaHDFSTest.testNormalFailedMove-seed#[7551A846818CF05E]) [n:127.0.0.1:59375_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node5/.
[junit4] 2> 2631870 INFO (zkConnectionManagerCallback-7851-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2631874 INFO (qtp1383850594-26143) [n:127.0.0.1:35540_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&autoAddReplicas=false&name=MoveReplicaHDFSTest_failed_coll_false&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2631884 INFO (OverseerThreadFactory-9183-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection MoveReplicaHDFSTest_failed_coll_false
[junit4] 2> 2632008 INFO (OverseerStateUpdate-72541200469000198-127.0.0.1:48821_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_false",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56089/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2632013 INFO (OverseerStateUpdate-72541200469000198-127.0.0.1:48821_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_false",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:59375/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2632020 INFO (OverseerStateUpdate-72541200469000198-127.0.0.1:48821_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_false",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48821/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2632025 INFO (OverseerStateUpdate-72541200469000198-127.0.0.1:48821_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_false",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35540/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2632369 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_false&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2632409 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_false&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2632418 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_false&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2632419 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2632429 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_false&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2633412 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2633443 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] Schema name=minimal
[junit4] 2> 2633470 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2633470 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6' using configuration from collection MoveReplicaHDFSTest_failed_coll_false, trusted=true
[junit4] 2> 2633470 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35540.solr.core.MoveReplicaHDFSTest_failed_coll_false.shard2.replica_n6' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_false.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2633480 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2633494 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2633504 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2633505 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://serv1-vm3:34093/data
[junit4] 2> 2633505 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2633505 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2633506 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node2/MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6], dataDir=[hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node8/data/]
[junit4] 2> 2633507 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] Schema name=minimal
[junit4] 2> 2633508 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2633508 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1' using configuration from collection MoveReplicaHDFSTest_failed_coll_false, trusted=true
[junit4] 2> 2633509 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node8/data/snapshot_metadata
[junit4] 2> 2633509 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56089.solr.core.MoveReplicaHDFSTest_failed_coll_false.shard1.replica_n1' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_false.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2633510 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://serv1-vm3:34093/data
[junit4] 2> 2633511 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2633511 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2633511 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node1/MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1], dataDir=[hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node3/data/]
[junit4] 2> 2633514 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node3/data/snapshot_metadata
[junit4] 2> 2633520 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2633551 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2633551 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4' using configuration from collection MoveReplicaHDFSTest_failed_coll_false, trusted=true
[junit4] 2> 2633552 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48821.solr.core.MoveReplicaHDFSTest_failed_coll_false.shard2.replica_n4' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_false.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2633554 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://serv1-vm3:34093/data
[junit4] 2> 2633554 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2633554 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2633554 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node4/MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4], dataDir=[hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node7/data/]
[junit4] 2> 2633561 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node7/data/snapshot_metadata
[junit4] 2> 2633582 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] Schema name=minimal
[junit4] 2> 2633611 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2633612 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2' using configuration from collection MoveReplicaHDFSTest_failed_coll_false, trusted=true
[junit4] 2> 2633613 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59375.solr.core.MoveReplicaHDFSTest_failed_coll_false.shard1.replica_n2' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_false.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb1c5e8
[junit4] 2> 2633613 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://serv1-vm3:34093/data
[junit4] 2> 2633613 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2633613 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2633613 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_7551A846818CF05E-001/tempDir-001/node5/MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2], dataDir=[hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node5/data/]
[junit4] 2> 2633617 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node5/data/snapshot_metadata
[junit4] 2> 2633625 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node8/data
[junit4] 2> 2633687 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node3/data
[junit4] 2> 2633689 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node7/data
[junit4] 2> 2633703 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node5/data
[junit4] 2> 2633719 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node8/data/index
[junit4] 2> 2633762 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node3/data/index
[junit4] 2> 2633771 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node7/data/index
[junit4] 2> 2633885 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://serv1-vm3:34093/data/MoveReplicaHDFSTest_failed_coll_false/core_node5/data/index
[junit4] 2> 2634100 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56148 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-9a1f0618-d4bb-4bbf-b1f8-f5b4db298ba8:NORMAL:127.0.0.1:33226|RBW], ReplicaUC[[DISK]DS-f743c915-4be7-4826-b05c-260a6b69259c:NORMAL:127.0.0.1:56148|RBW]]} size 69
[junit4] 2> 2634100 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33226 is added to blk_1073741825_1001 size 69
[junit4] 2> 2634173 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33226 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a6d857-4943-4864-99b4-2e1bd099fe0b:NORMAL:127.0.0.1:56148|RBW], ReplicaUC[[DISK]DS-0dcbeca6-5e8c-442d-ba7e-797ccba8b790:NORMAL:127.0.0.1:33226|RBW]]} size 0
[junit4] 2> 2634178 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56148 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a6d857-4943-4864-99b4-2e1bd099fe0b:NORMAL:127.0.0.1:56148|RBW], ReplicaUC[[DISK]DS-0dcbeca6-5e8c-442d-ba7e-797ccba8b790:NORMAL:127.0.0.1:33226|RBW]]} size 0
[junit4] 2> 2634184 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56148 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-9a1f0618-d4bb-4bbf-b1f8-f5b4db298ba8:NORMAL:127.0.0.1:33226|RBW], ReplicaUC[[DISK]DS-f743c915-4be7-4826-b05c-260a6b69259c:NORMAL:127.0.0.1:56148|RBW]]} size 0
[junit4] 2> 2634184 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33226 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-9a1f0618-d4bb-4bbf-b1f8-f5b4db298ba8:NORMAL:127.0.0.1:33226|RBW], ReplicaUC[[DISK]DS-f743c915-4be7-4826-b05c-260a6b69259c:NORMAL:127.0.0.1:56148|RBW]]} size 0
[junit4] 2> 2634267 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56148 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0dcbeca6-5e8c-442d-ba7e-797ccba8b790:NORMAL:127.0.0.1:33226|RBW], ReplicaUC[[DISK]DS-f743c915-4be7-4826-b05c-260a6b69259c:NORMAL:127.0.0.1:56148|FINALIZED]]} size 0
[junit4] 2> 2634267 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33226 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-f743c915-4be7-4826-b05c-260a6b69259c:NORMAL:127.0.0.1:56148|FINALIZED], ReplicaUC[[DISK]DS-9a1f0618-d4bb-4bbf-b1f8-f5b4db298ba8:NORMAL:127.0.0.1:33226|FINALIZED]]} size 0
[junit4] 2> 2634403 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2634403 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2634403 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2634408 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2634408 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2634408 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2634460 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2634460 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2634464 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2634464 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2634484 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2634484 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2634484 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2634515 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@769aa79[MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] main]
[junit4] 2> 2634518 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2634518 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2634545 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2634546 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2634609 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@22b5d7d9[MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] main]
[junit4] 2> 2634614 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2634615 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2634617 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@7152a36c[MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] main]
[junit4] 2> 2634618 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2634619 INFO (searcherExecutor-9219-thread-1-processing-n:127.0.0.1:48821_solr x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4 c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.SolrCore [MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] Registered new searcher Searcher@769aa79[MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2634619 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606533965726875648
[junit4] 2> 2634621 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2634622 INFO (searcherExecutor-9218-thread-1-processing-n:127.0.0.1:56089_solr x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1 c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.SolrCore [MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] Registered new searcher Searcher@22b5d7d9[MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2634622 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606533965730021376
[junit4] 2> 2634632 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_failed_coll_false/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 2634641 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2634641 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2634641 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2634644 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2634644 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2634650 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2634650 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606533965759381504
[junit4] 2> 2634655 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9997ms
[junit4] 2> 2634657 INFO (searcherExecutor-9220-thread-1-processing-n:127.0.0.1:59375_solr x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2 c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.SolrCore [MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] Registered new searcher Searcher@7152a36c[MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2634661 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_failed_coll_false/terms/shard2 to Terms{values={core_node7=0}, version=0}
[junit4] 2> 2634674 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9998ms
[junit4] 2> 2634674 INFO (qtp1589952886-26417) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_failed_coll_false/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
[junit4] 2> 2634680 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2634680 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2634731 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@748f678[MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] main]
[junit4] 2> 2634740 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2634742 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2634744 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2634745 INFO (searcherExecutor-9217-thread-1-processing-n:127.0.0.1:35540_solr x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6 c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.SolrCore [MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] Registered new searcher Searcher@748f678[MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2634745 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606533965858996224
[junit4] 2> 2634763 INFO (qtp1383850594-26142) [n:127.0.0.1:35540_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_failed_coll_false/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
[junit4] 2> 2635168 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2635168 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2635168 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:56089/solr/MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1/
[junit4] 2> 2635170 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1 url=https://127.0.0.1:56089/solr START replicas=[https://127.0.0.1:59375/solr/MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2/] nUpdates=100
[junit4] 2> 2635171 INFO (qtp1642197477-26119) [n:127.0.0.1:56089_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n1 url=https://127.0.0.1:56089/solr DONE. We have no versions. sync failed.
[junit4] 2> 2635185 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2635185 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2635185 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:48821/solr/MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4/
[junit4] 2> 2635186 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4 url=https://127.0.0.1:48821/solr START replicas=[https://127.0.0.1:35540/solr/MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n6/] nUpdates=100
[junit4] 2> 2635188 INFO (qtp1480684995-26146) [n:127.0.0.1:48821_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_failed_coll_false_shard2_replica_n4 url=https://127.0.0.1:48821/solr DONE. We have no versions. sync failed.
[junit4] 2> 2635228 INFO (qtp1589952886-26415) [n:127.0.0.1:59375_solr c:MoveReplicaHDFSTest_failed_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] o.a.s.c.S.Request [MoveReplicaHDFSTest_failed_coll_false_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 2635233 INFO
[...truncated too long message...]
is/solr/core/build.xml
-clover.disable:
ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/top-level-ivy-settings.xml
install-junit4-taskdef:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 34ms :: artifacts dl 1ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 1 | 0 | 0 | 0 || 1 | 0 |
---------------------------------------------------------------------
-init-totals:
-test:
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 7551A846818CF05E
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/temp
[junit4] <JUnit4> says ahoj! Master seed: 7551A846818CF05E
[junit4] Executing 5 suites with 2 JVMs.
[junit4]
[junit4] Started J1 PID(2900@serv1-vm3).
[junit4] Started J0 PID(2901@serv1-vm3).
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] OK 17.0s J0 | MoveReplicaHDFSTest.testNormalFailedMove
[junit4] OK 25.4s J0 | MoveReplicaHDFSTest.test
[junit4] OK 27.7s J0 | MoveReplicaHDFSTest.testNormalMove
[junit4] OK 17.5s J0 | MoveReplicaHDFSTest.testFailedMove
[junit4] Completed [1/5] on J0 in 118.11s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] OK 17.4s J1 | MoveReplicaHDFSTest.testNormalFailedMove
[junit4] OK 27.1s J1 | MoveReplicaHDFSTest.test
[junit4] OK 26.4s J1 | MoveReplicaHDFSTest.testNormalMove
[junit4] OK 18.3s J1 | MoveReplicaHDFSTest.testFailedMove
[junit4] Completed [2/5] on J1 in 121.94s, 4 tests
[junit4]
[junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.MoveReplicaHDFSTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] OK 13.9s J0 | MoveReplicaHDFSTest.testNormalFailedMove
[junit4] OK 24.8s J0 | MoveReplicaHDFSTest.test
[junit4] OK 28.6s J0 | MoveReplicaHDFSTest.testNormalMove
[junit4] OK 18.0s J0 | MoveReplicaHDFSTest.testFailedMove
[junit4] Completed [3/5] on J0 in 103.69s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] OK 12.9s J1 | MoveReplicaHDFSTest.testNormalFailedMove
[junit4] OK 27.1s J1 | MoveReplicaHDFSTest.test
[junit4] OK 24.8s J1 | MoveReplicaHDFSTest.testNormalMove
[junit4] OK 19.4s J1 | MoveReplicaHDFSTest.testFailedMove
[junit4] Completed [4/5] on J1 in 105.01s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] OK 14.9s J0 | MoveReplicaHDFSTest.testNormalFailedMove
[junit4] OK 22.2s J0 | MoveReplicaHDFSTest.test
[junit4] OK 20.1s J0 | MoveReplicaHDFSTest.testNormalMove
[junit4] OK 17.4s J0 | MoveReplicaHDFSTest.testFailedMove
[junit4] Completed [5/5] on J0 in 89.97s, 4 tests
[junit4]
[junit4] JVM J0: 0.72 .. 313.67 = 312.96s
[junit4] JVM J1: 0.71 .. 228.78 = 228.07s
[junit4] Execution time total: 5 minutes 13 seconds
[junit4] Tests summary: 5 suites, 20 tests
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp])
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp])
[echo] 5 slowest tests:
[junit4:tophints] 222.43s | org.apache.solr.update.TestInPlaceUpdatesDistrib
[junit4:tophints] 134.72s | org.apache.solr.search.TestStressRecovery
[junit4:tophints] 120.03s | org.apache.solr.cloud.DeleteReplicaTest
[junit4:tophints] 119.28s | org.apache.solr.cloud.ZkFailoverTest
[junit4:tophints] 117.52s | org.apache.solr.cloud.TestTlogReplica
-check-totals:
test-nocompile:
BUILD SUCCESSFUL
Total time: 5 minutes 16 seconds
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.MoveReplicaHDFSTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2843)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2722)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2703)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3082)
Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
at hudson.remoting.Channel.call(Channel.java:955)
at hudson.FilePath.act(FilePath.java:1089)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084)
at hudson.remoting.UserRequest.perform(UserRequest.java:212)
at hudson.remoting.UserRequest.perform(UserRequest.java:54)
at hudson.remoting.Request$2.run(Request.java:369)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath.act(FilePath.java:1091)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=540839d0d237e38872079e37c7819c4a9b7c8bd2, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #734
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 734 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/734/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:64816 within 30000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:64816 within 30000 ms
at __randomizedtesting.SeedInfo.seed([472FC7C4FB7B8902]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:121)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:116)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:103)
at org.apache.solr.cloud.MiniSolrCloudCluster.waitForAllNodes(MiniSolrCloudCluster.java:269)
at org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:263)
at org.apache.solr.cloud.SolrCloudTestCase$Builder.build(SolrCloudTestCase.java:198)
at org.apache.solr.cloud.SolrCloudTestCase$Builder.configure(SolrCloudTestCase.java:190)
at org.apache.solr.cloud.TestDeleteCollectionOnDownNodes.setupCluster(TestDeleteCollectionOnDownNodes.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:64816 within 30000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:232)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:176)
... 32 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
Error Message:
41 threads leaked from SUITE scope at org.apache.solr.cloud.TestDeleteCollectionOnDownNodes: 1) Thread[id=25308, name=qtp157627449-25308, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method) at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=25292, name=qtp1615186491-25292, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=25289, name=qtp1615186491-25289, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=25319, name=qtp1097720950-25319-acceptor-0@3c992802-ServerConnector@64da368a{HTTP/1.1,[http/1.1]}{127.0.0.1:62104}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=25302, name=qtp98578168-25302, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=25304, name=qtp1097720950-25304, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method) at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=25303, name=qtp157627449-25303, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=25296, name=qtp98578168-25296, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method) at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=25295, name=qtp98578168-25295, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=25307, name=qtp157627449-25307, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=25278, name=ProcessThread(sid:0 cport:64816):, state=WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123) 12) Thread[id=25298, name=qtp98578168-25298, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 13) Thread[id=25309, name=qtp157627449-25309, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 14) Thread[id=25276, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at java.lang.Object.wait(Native Method) at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147) 15) Thread[id=25294, name=Scheduler-1063894552, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 16) Thread[id=25323, name=qtp1097720950-25323, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 17) Thread[id=25324, name=qtp1097720950-25324, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 18) Thread[id=25290, name=qtp1615186491-25290, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 19) Thread[id=25306, name=qtp157627449-25306, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 20) Thread[id=25314, name=qtp1615186491-25314, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 21) Thread[id=25286, name=qtp1615186491-25286, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 22) Thread[id=25288, name=qtp1615186491-25288, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method) at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 23) Thread[id=25320, name=qtp1097720950-25320, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 24) Thread[id=25331, name=Scheduler-187158580, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 25) Thread[id=25313, name=Scheduler-1880718291, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 26) Thread[id=25287, name=qtp1615186491-25287-acceptor-0@73c25234-ServerConnector@20d07e{HTTP/1.1,[http/1.1]}{127.0.0.1:60843}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 27) Thread[id=25312, name=Scheduler-1033076460, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 28) Thread[id=25310, name=qtp157627449-25310-acceptor-0@2c958f52-ServerConnector@2a22e654{HTTP/1.1,[http/1.1]}{127.0.0.1:63268}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 29) Thread[id=25326, name=Scheduler-1562521896, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 30) Thread[id=25291, name=qtp1615186491-25291, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 31) Thread[id=25305, name=qtp157627449-25305, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 32) Thread[id=25311, name=qtp157627449-25311, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 33) Thread[id=25275, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method) at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196) at java.lang.Thread.run(Thread.java:748) 34) Thread[id=25300, name=qtp98578168-25300, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:292) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:357) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 35) Thread[id=25321, name=qtp1097720950-25321, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 36) Thread[id=25297, name=qtp98578168-25297-acceptor-0@dcddaec-ServerConnector@42f5eb77{HTTP/1.1,[http/1.1]}{127.0.0.1:64816}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 37) Thread[id=25301, name=qtp98578168-25301, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 38) Thread[id=25299, name=qtp98578168-25299, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 39) Thread[id=25325, name=qtp1097720950-25325, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748) 40) Thread[id=25274, name=Thread-5306, state=WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1252) at java.lang.Thread.join(Thread.java:1326) at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313) at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313) at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496) 41) Thread[id=25322, name=qtp1097720950-25322, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 41 threads leaked from SUITE scope at org.apache.solr.cloud.TestDeleteCollectionOnDownNodes:
1) Thread[id=25308, name=qtp157627449-25308, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=25292, name=qtp1615186491-25292, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=25289, name=qtp1615186491-25289, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=25319, name=qtp1097720950-25319-acceptor-0@3c992802-ServerConnector@64da368a{HTTP/1.1,[http/1.1]}{127.0.0.1:62104}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=25302, name=qtp98578168-25302, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=25304, name=qtp1097720950-25304, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=25303, name=qtp157627449-25303, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=25296, name=qtp98578168-25296, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
9) Thread[id=25295, name=qtp98578168-25295, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=25307, name=qtp157627449-25307, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
11) Thread[id=25278, name=ProcessThread(sid:0 cport:64816):, state=WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
12) Thread[id=25298, name=qtp98578168-25298, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
13) Thread[id=25309, name=qtp157627449-25309, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
14) Thread[id=25276, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at java.lang.Object.wait(Native Method)
at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)
15) Thread[id=25294, name=Scheduler-1063894552, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
16) Thread[id=25323, name=qtp1097720950-25323, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
17) Thread[id=25324, name=qtp1097720950-25324, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
18) Thread[id=25290, name=qtp1615186491-25290, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
19) Thread[id=25306, name=qtp157627449-25306, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
20) Thread[id=25314, name=qtp1615186491-25314, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
21) Thread[id=25286, name=qtp1615186491-25286, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
22) Thread[id=25288, name=qtp1615186491-25288, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
23) Thread[id=25320, name=qtp1097720950-25320, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
24) Thread[id=25331, name=Scheduler-187158580, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
25) Thread[id=25313, name=Scheduler-1880718291, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
26) Thread[id=25287, name=qtp1615186491-25287-acceptor-0@73c25234-ServerConnector@20d07e{HTTP/1.1,[http/1.1]}{127.0.0.1:60843}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
27) Thread[id=25312, name=Scheduler-1033076460, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
28) Thread[id=25310, name=qtp157627449-25310-acceptor-0@2c958f52-ServerConnector@2a22e654{HTTP/1.1,[http/1.1]}{127.0.0.1:63268}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
29) Thread[id=25326, name=Scheduler-1562521896, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
30) Thread[id=25291, name=qtp1615186491-25291, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
31) Thread[id=25305, name=qtp157627449-25305, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
32) Thread[id=25311, name=qtp157627449-25311, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
33) Thread[id=25275, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
at java.lang.Thread.run(Thread.java:748)
34) Thread[id=25300, name=qtp98578168-25300, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:292)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:357)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
35) Thread[id=25321, name=qtp1097720950-25321, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
36) Thread[id=25297, name=qtp98578168-25297-acceptor-0@dcddaec-ServerConnector@42f5eb77{HTTP/1.1,[http/1.1]}{127.0.0.1:64816}, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
37) Thread[id=25301, name=qtp98578168-25301, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
38) Thread[id=25299, name=qtp98578168-25299, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
39) Thread[id=25325, name=qtp1097720950-25325, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
40) Thread[id=25274, name=Thread-5306, state=WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1252)
at java.lang.Thread.join(Thread.java:1326)
at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)
41) Thread[id=25322, name=qtp1097720950-25322, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([472FC7C4FB7B8902]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=25308, name=qtp157627449-25308, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.interrupt(Native Method) at sun.nio.ch.DevPollArrayWrapper.interrupt(DevPollArrayWrapper.java:300) at sun.nio.ch.DevPollSelectorImpl.wakeup(DevPollSelectorImpl.java:207) at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:97) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:401) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=25294, name=Scheduler-1063894552, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=25275, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method) at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=25296, name=qtp98578168-25296, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.interrupt(Native Method) at sun.nio.ch.DevPollArrayWrapper.interrupt(DevPollArrayWrapper.java:300) at sun.nio.ch.DevPollSelectorImpl.wakeup(DevPollSelectorImpl.java:207) at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:97) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:401) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=25300, name=qtp98578168-25300, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:292) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:357) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=25288, name=qtp1615186491-25288, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.interrupt(Native Method) at sun.nio.ch.DevPollArrayWrapper.interrupt(DevPollArrayWrapper.java:300) at sun.nio.ch.DevPollSelectorImpl.wakeup(DevPollSelectorImpl.java:207) at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:97) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:401) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=25331, name=Scheduler-187158580, state=WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=25313, name=Scheduler-1880718291, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=25304, name=qtp1097720950-25304, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method) at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223) at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:401) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132) at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=25312, name=Scheduler-1033076460, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=25326, name=Scheduler-1562521896, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=25308, name=qtp157627449-25308, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.DevPollArrayWrapper.interrupt(Native Method)
at sun.nio.ch.DevPollArrayWrapper.interrupt(DevPollArrayWrapper.java:300)
at sun.nio.ch.DevPollSelectorImpl.wakeup(DevPollSelectorImpl.java:207)
at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:401)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
at org.eclipse.jetty.io.ManagedSelector$$Lambda$372/1900574517.run(Unknown Source)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=25294, name=Scheduler-1063894552, state=TIMED_WAITING, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=25275, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-TestDeleteCollectionOnDownNodes]
at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxn
[...truncated too long message...]
:unchecked for details.
[javac] Creating empty /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/classes/test/org/apache/solr/cloud/autoscaling/sim/package-info.class
[copy] Copying 1 file to /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/classes/test
common-solr.compile-test:
compile-test:
BUILD SUCCESSFUL
Total time: 57 seconds
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestDeleteCollectionOnDownNodes" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=472FC7C4FB7B8902 -Dtests.slow=true -Dtests.locale=de -Dtests.timezone=CST -Dtests.asserts=true -Dtests.file.encoding=UTF-8
Buildfile: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/build.xml
-clover.disable:
ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/top-level-ivy-settings.xml
install-junit4-taskdef:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 15ms :: artifacts dl 0ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 1 | 0 | 0 | 0 || 1 | 0 |
---------------------------------------------------------------------
-init-totals:
-test:
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 472FC7C4FB7B8902
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/temp
[junit4] <JUnit4> says cześć! Master seed: 472FC7C4FB7B8902
[junit4] Executing 5 suites with 2 JVMs.
[junit4]
[junit4] Started J1 PID(28414@serv1-vm3).
[junit4] Started J0 PID(28415@serv1-vm3).
[junit4] Suite: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
[junit4] OK 8.84s J0 | TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
[junit4] Completed [1/5] on J0 in 17.28s, 1 test
[junit4]
[junit4] Suite: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
[junit4] OK 12.1s J1 | TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
[junit4] Completed [2/5] on J1 in 20.27s, 1 test
[junit4]
[junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
[junit4] Suite: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
[junit4] OK 8.79s J0 | TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
[junit4] Completed [3/5] on J0 in 12.88s, 1 test
[junit4]
[junit4] Suite: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
[junit4] OK 7.94s J1 | TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
[junit4] Completed [4/5] on J1 in 12.48s, 1 test
[junit4]
[junit4] Suite: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
[junit4] OK 5.34s J0 | TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
[junit4] Completed [5/5] on J0 in 7.82s, 1 test
[junit4]
[junit4] JVM J0: 0.75 .. 39.68 = 38.94s
[junit4] JVM J1: 0.73 .. 34.35 = 33.62s
[junit4] Execution time total: 39 seconds
[junit4] Tests summary: 5 suites, 5 tests
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp])
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp])
[echo] 5 slowest tests:
[junit4:tophints] 117.22s | org.apache.solr.update.SoftAutoCommitTest
[junit4:tophints] 116.88s | org.apache.solr.cloud.ZkFailoverTest
[junit4:tophints] 114.38s | org.apache.solr.cloud.TestTlogReplica
[junit4:tophints] 111.22s | org.apache.solr.cloud.DeleteReplicaTest
[junit4:tophints] 103.76s | org.apache.solr.cloud.TestPullReplica
-check-totals:
test-nocompile:
BUILD SUCCESSFUL
Total time: 42 seconds
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2843)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2722)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2703)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3082)
Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
at hudson.remoting.Channel.call(Channel.java:955)
at hudson.FilePath.act(FilePath.java:1089)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084)
at hudson.remoting.UserRequest.perform(UserRequest.java:212)
at hudson.remoting.UserRequest.perform(UserRequest.java:54)
at hudson.remoting.Request$2.run(Request.java:369)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath.act(FilePath.java:1091)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=5c40fe5906ecc5eabb89bf1a3086dd9121402d61, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #733
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 733 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/733/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
3 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:38443/wx_jje/wm/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:38443/wx_jje/wm/collection1
at __randomizedtesting.SeedInfo.seed([8A2193AFFD97F591:275AC75536B9869]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:484)
at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:463)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.commit(AbstractFullDistribZkTestBase.java:1591)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:213)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1008)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 53 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
Error Message:
4 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest: 1) Thread[id=1662, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]-SendThread(127.0.0.1:55133), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054) 2) Thread[id=1664, name=zkConnectionManagerCallback-351-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=1661, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=1663, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:
1) Thread[id=1662, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]-SendThread(127.0.0.1:55133), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
2) Thread[id=1664, name=zkConnectionManagerCallback-351-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=1661, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=1663, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
at __randomizedtesting.SeedInfo.seed([8A2193AFFD97F591]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=1662, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]-SendThread(127.0.0.1:55133), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063) 2) Thread[id=1664, name=zkConnectionManagerCallback-351-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=1662, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]-SendThread(127.0.0.1:55133), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
2) Thread[id=1664, name=zkConnectionManagerCallback-351-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([8A2193AFFD97F591]:0)
Build Log:
[...truncated 12368 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/init-core-data-001
[junit4] 2> 247020 WARN (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[8A2193AFFD97F591]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=37 numCloses=37
[junit4] 2> 247021 INFO (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[8A2193AFFD97F591]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 247022 INFO (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[8A2193AFFD97F591]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 247022 INFO (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[8A2193AFFD97F591]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 247022 INFO (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[8A2193AFFD97F591]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /wx_jje/wm
[junit4] 2> 247024 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 247028 INFO (Thread-287) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 247028 INFO (Thread-287) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 247030 ERROR (Thread-287) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 247124 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.ZkTestServer start zk server on port:55133
[junit4] 2> 247129 INFO (zkConnectionManagerCallback-323-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 247136 INFO (zkConnectionManagerCallback-325-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 247149 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 247154 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 247157 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 247160 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 247162 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 247165 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 247168 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 247186 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 247189 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 247193 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 247195 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 247200 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 247407 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 247424 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 247424 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 247424 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 247429 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18119c93{/wx_jje/wm,null,AVAILABLE}
[junit4] 2> 247459 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6df69843{HTTP/1.1,[http/1.1]}{127.0.0.1:62543}
[junit4] 2> 247460 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server Started @247668ms
[junit4] 2> 247460 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/tempDir-001/control/data, replicaType=NRT, hostContext=/wx_jje/wm, hostPort=62543, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/control-001/cores}
[junit4] 2> 247460 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 247460 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 247460 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.5.0
[junit4] 2> 247460 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 247460 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 247460 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-19T19:44:10.350Z
[junit4] 2> 247466 INFO (zkConnectionManagerCallback-327-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 247475 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101b3061e430002, likely client has closed socket
[junit4] 2> 247476 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 247476 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/control-001/solr.xml
[junit4] 2> 247490 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 247490 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 247492 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 249198 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55133/solr
[junit4] 2> 249201 INFO (zkConnectionManagerCallback-331-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 249206 INFO (zkConnectionManagerCallback-333-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 249369 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62543_wx_jje%2Fwm
[junit4] 2> 249371 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.c.Overseer Overseer (id=72535907873521668-127.0.0.1:62543_wx_jje%2Fwm-n_0000000000) starting
[junit4] 2> 249386 INFO (zkConnectionManagerCallback-340-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 249389 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55133/solr ready
[junit4] 2> 249390 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62543_wx_jje%2Fwm
[junit4] 2> 249391 INFO (OverseerStateUpdate-72535907873521668-127.0.0.1:62543_wx_jje%2Fwm-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:62543_wx_jje%2Fwm
[junit4] 2> 249395 INFO (zkCallback-339-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 249397 INFO (OverseerStateUpdate-72535907873521668-127.0.0.1:62543_wx_jje%2Fwm-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 249414 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 249429 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 249435 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 249435 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 249436 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/control-001/cores
[junit4] 2> 249458 INFO (zkConnectionManagerCallback-346-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 249461 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 249463 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55133/solr ready
[junit4] 2> 249465 INFO (qtp2071833426-1617) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:62543_wx_jje%252Fwm&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 249469 INFO (OverseerThreadFactory-793-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 249630 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 249631 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 250667 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 250679 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 250752 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 250776 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 250776 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 250782 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 250783 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 250785 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=22.1201171875, floorSegmentMB=1.755859375, forceMergeDeletesPctAllowed=3.714788130821419, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=36.75914019998842
[junit4] 2> 250837 WARN (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 250897 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 250897 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 250898 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 250898 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 250899 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=63.359375, floorSegmentMB=0.455078125, forceMergeDeletesPctAllowed=0.7237540865680592, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=22.849708033834393
[junit4] 2> 250900 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c9a273e[control_collection_shard1_replica_n1] main]
[junit4] 2> 250901 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 250902 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 250902 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 250903 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606449316540448768
[junit4] 2> 250904 INFO (searcherExecutor-798-thread-1-processing-n:127.0.0.1:62543_wx_jje%2Fwm x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@3c9a273e[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 250911 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 250917 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 250917 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 250917 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62543/wx_jje/wm/control_collection_shard1_replica_n1/
[junit4] 2> 250918 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 250918 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:62543/wx_jje/wm/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 250918 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 250926 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62543/wx_jje/wm/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 251033 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 251037 INFO (qtp2071833426-1612) [n:127.0.0.1:62543_wx_jje%2Fwm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1407
[junit4] 2> 251041 INFO (qtp2071833426-1617) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 251139 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 251471 INFO (OverseerCollectionConfigSetProcessor-72535907873521668-127.0.0.1:62543_wx_jje%2Fwm-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 252044 INFO (qtp2071833426-1617) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:62543_wx_jje%252Fwm&wt=javabin&version=2} status=0 QTime=2580
[junit4] 2> 252052 INFO (zkConnectionManagerCallback-351-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 252054 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 252055 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55133/solr ready
[junit4] 2> 252056 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 252057 INFO (qtp2071833426-1615) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 252062 INFO (OverseerThreadFactory-793-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 252063 WARN (OverseerThreadFactory-793-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 252271 INFO (qtp2071833426-1615) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 252271 INFO (qtp2071833426-1615) [n:127.0.0.1:62543_wx_jje%2Fwm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=214
[junit4] 2> 252395 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-1-001 of type TLOG
[junit4] 2> 252395 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 252397 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 252397 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 252397 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 252397 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4193c106{/wx_jje/wm,null,AVAILABLE}
[junit4] 2> 252397 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@65b97f1b{HTTP/1.1,[http/1.1]}{127.0.0.1:38443}
[junit4] 2> 252397 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server Started @252608ms
[junit4] 2> 252397 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/wx_jje/wm, hostPort=38443, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-1-001/cores}
[junit4] 2> 252398 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 252398 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 252399 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.5.0
[junit4] 2> 252399 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 252399 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 252399 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-19T19:44:15.289Z
[junit4] 2> 252402 INFO (zkConnectionManagerCallback-353-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 252405 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 252405 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-1-001/solr.xml
[junit4] 2> 252409 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 252409 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 252410 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 252879 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55133/solr
[junit4] 2> 252884 INFO (zkConnectionManagerCallback-357-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 252889 INFO (zkConnectionManagerCallback-359-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 252902 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 252912 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 252912 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38443_wx_jje%2Fwm
[junit4] 2> 252914 INFO (zkCallback-339-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 252914 INFO (zkCallback-350-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 252914 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 252915 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 252940 INFO (zkConnectionManagerCallback-366-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 252942 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 252944 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55133/solr ready
[junit4] 2> 252945 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 252960 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 252966 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 252967 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 252968 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-1-001/cores
[junit4] 2> 252998 INFO (qtp567513376-1671) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38443_wx_jje%252Fwm&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 253005 INFO (OverseerCollectionConfigSetProcessor-72535907873521668-127.0.0.1:62543_wx_jje%2Fwm-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 253005 INFO (OverseerThreadFactory-793-thread-3) [ c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38443_wx_jje%2Fwm for creating new replica
[junit4] 2> 253011 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm x:collection1_shard2_replica_t61] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 254029 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 254046 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.s.IndexSchema [collection1_shard2_replica_t61] Schema name=test
[junit4] 2> 254115 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 254140 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t61' using configuration from collection collection1, trusted=true
[junit4] 2> 254140 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t61' (registry 'solr.core.collection1.shard2.replica_t61') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 254140 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 254140 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.SolrCore [[collection1_shard2_replica_t61] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-1-001/cores/collection1_shard2_replica_t61], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-1-001/cores/collection1_shard2_replica_t61/data/]
[junit4] 2> 254143 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=22.1201171875, floorSegmentMB=1.755859375, forceMergeDeletesPctAllowed=3.714788130821419, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=36.75914019998842
[junit4] 2> 254214 WARN (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 254260 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 254260 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 254260 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 254260 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 254261 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=63.359375, floorSegmentMB=0.455078125, forceMergeDeletesPctAllowed=0.7237540865680592, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=22.849708033834393
[junit4] 2> 254262 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.s.SolrIndexSearcher Opening [Searcher@4cc46dd3[collection1_shard2_replica_t61] main]
[junit4] 2> 254264 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 254264 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 254265 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 254265 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606449320065761280
[junit4] 2> 254268 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:38443_wx_jje%2Fwm x:collection1_shard2_replica_t61 c:collection1 s:shard2) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.SolrCore [collection1_shard2_replica_t61] Registered new searcher Searcher@4cc46dd3[collection1_shard2_replica_t61] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 254274 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node62=0}, version=0}
[junit4] 2> 254278 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 254278 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 254278 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38443/wx_jje/wm/collection1_shard2_replica_t61/
[junit4] 2> 254278 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 254278 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.SyncStrategy http://127.0.0.1:38443/wx_jje/wm/collection1_shard2_replica_t61/ has no replicas
[junit4] 2> 254278 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 254279 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.ZkController collection1_shard2_replica_t61 stopping background replication from leader
[junit4] 2> 254284 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38443/wx_jje/wm/collection1_shard2_replica_t61/ shard2
[junit4] 2> 254436 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 254440 INFO (qtp567513376-1667) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 s:shard2 x:collection1_shard2_replica_t61] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1431
[junit4] 2> 254444 INFO (qtp567513376-1671) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38443_wx_jje%252Fwm&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1446
[junit4] 2> 254567 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-2-001 of type TLOG
[junit4] 2> 254568 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 254569 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 254569 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 254569 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 254569 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@40f4626f{/wx_jje/wm,null,AVAILABLE}
[junit4] 2> 254570 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6075b096{HTTP/1.1,[http/1.1]}{127.0.0.1:64585}
[junit4] 2> 254570 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server Started @254782ms
[junit4] 2> 254570 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/wx_jje/wm, hostPort=64585, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-2-001/cores}
[junit4] 2> 254570 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 254571 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 254571 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.5.0
[junit4] 2> 254571 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 254571 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 254571 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-19T19:44:17.461Z
[junit4] 2> 254578 INFO (zkConnectionManagerCallback-369-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 254581 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 254581 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-2-001/solr.xml
[junit4] 2> 254583 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 254583 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 254584 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 255008 INFO (OverseerCollectionConfigSetProcessor-72535907873521668-127.0.0.1:62543_wx_jje%2Fwm-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 256098 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55133/solr
[junit4] 2> 256101 INFO (zkConnectionManagerCallback-373-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256106 INFO (zkConnectionManagerCallback-375-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256130 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 256137 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 256137 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64585_wx_jje%2Fwm
[junit4] 2> 256139 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 256139 INFO (zkCallback-365-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 256139 INFO (zkCallback-350-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 256157 INFO (zkCallback-339-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 256157 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 256158 INFO (zkCallback-374-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 256160 INFO (zkConnectionManagerCallback-382-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256162 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 256163 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55133/solr ready
[junit4] 2> 256164 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 256177 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 256182 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 256182 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 256184 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:64585_wx_jje%2Fwm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-2-001/cores
[junit4] 2> 256206 INFO (qtp567513376-1670) [n:127.0.0.1:38443_wx_jje%2Fwm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:64585_wx_jje%252Fwm&action=ADDREPLICA&collection=collection1&shard=shard3&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 256209 INFO (OverseerThreadFactory-793-thread-4) [ c:collection1 s:shard3 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:64585_wx_jje%2Fwm for creating new replica
[junit4] 2> 256213 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm x:collection1_shard3_replica_t63] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_t63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 257228 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 257251 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.s.IndexSchema [collection1_shard3_replica_t63] Schema name=test
[junit4] 2> 257318 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 257343 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_t63' using configuration from collection collection1, trusted=true
[junit4] 2> 257344 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard3.replica_t63' (registry 'solr.core.collection1.shard3.replica_t63') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 257344 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 257344 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.SolrCore [[collection1_shard3_replica_t63] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-2-001/cores/collection1_shard3_replica_t63], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-2-001/cores/collection1_shard3_replica_t63/data/]
[junit4] 2> 257347 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=22.1201171875, floorSegmentMB=1.755859375, forceMergeDeletesPctAllowed=3.714788130821419, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=36.75914019998842
[junit4] 2> 257451 WARN (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 257516 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 257516 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 257517 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 257517 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 257519 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=63.359375, floorSegmentMB=0.455078125, forceMergeDeletesPctAllowed=0.7237540865680592, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=22.849708033834393
[junit4] 2> 257519 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.s.SolrIndexSearcher Opening [Searcher@652e1cc4[collection1_shard3_replica_t63] main]
[junit4] 2> 257521 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 257522 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 257523 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 257523 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606449323482021888
[junit4] 2> 257525 INFO (searcherExecutor-826-thread-1-processing-n:127.0.0.1:64585_wx_jje%2Fwm x:collection1_shard3_replica_t63 c:collection1 s:shard3) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.SolrCore [collection1_shard3_replica_t63] Registered new searcher Searcher@652e1cc4[collection1_shard3_replica_t63] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 257531 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard3 to Terms{values={core_node64=0}, version=0}
[junit4] 2> 257536 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 257536 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 257536 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64585/wx_jje/wm/collection1_shard3_replica_t63/
[junit4] 2> 257536 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 257536 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.SyncStrategy http://127.0.0.1:64585/wx_jje/wm/collection1_shard3_replica_t63/ has no replicas
[junit4] 2> 257536 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 257536 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.ZkController collection1_shard3_replica_t63 stopping background replication from leader
[junit4] 2> 257543 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64585/wx_jje/wm/collection1_shard3_replica_t63/ shard3
[junit4] 2> 257654 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 257659 INFO (qtp1500114882-1709) [n:127.0.0.1:64585_wx_jje%2Fwm c:collection1 s:shard3 x:collection1_shard3_replica_t63] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_t63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1446
[junit4] 2> 257662 INFO (qtp567513376-1670) [n:127.0.0.1:38443_wx_jje%2Fwm c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:64585_wx_jje%252Fwm&action=ADDREPLICA&collection=collection1&shard=shard3&type=TLOG&wt=javabin&version=2} status=0 QTime=1456
[junit4] 2> 257860 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-3-001 of type TLOG
[junit4] 2> 257860 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 257862 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 257862 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 257862 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 257862 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5aaaa1a{/wx_jje/wm,null,AVAILABLE}
[junit4] 2> 257863 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@78a6a251{HTTP/1.1,[http/1.1]}{127.0.0.1:38178}
[junit4] 2> 257863 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.e.j.s.Server Started @258077ms
[junit4] 2> 257863 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/wx_jje/wm, hostPort=38178, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-3-001/cores}
[junit4] 2> 257863 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 257863 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 257863 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.5.0
[junit4] 2> 257864 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 257864 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 257864 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-19T19:44:20.754Z
[junit4] 2> 257867 INFO (zkConnectionManagerCallback-385-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 257869 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 257869 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-3-001/solr.xml
[junit4] 2> 257873 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 257873 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 257875 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 258212 INFO (OverseerCollectionConfigSetProcessor-72535907873521668-127.0.0.1:62543_wx_jje%2Fwm-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 258920 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55133/solr
[junit4] 2> 258923 INFO (zkConnectionManagerCallback-389-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 258928 INFO (zkConnectionManagerCallback-391-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 258941 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 258949 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 258949 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38178_wx_jje%2Fwm
[junit4] 2> 258951 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258951 INFO (zkCallback-365-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258952 INFO (zkCallback-381-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258952 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258952 INFO (zkCallback-374-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258952 INFO (zkCallback-350-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258952 INFO (zkCallback-339-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258954 INFO (zkCallback-390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 258981 INFO (zkConnectionManagerCallback-398-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 258984 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 258986 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55133/solr ready
[junit4] 2> 258986 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 259004 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 259012 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 259012 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 259014 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[8A2193AFFD97F591]) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_8A2193AFFD97F591-001/shard-3-001/cores
[junit4] 2> 259050 INFO (qtp97481626-1747) [n:127.0.0.1:38178_wx_jje%2Fwm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38178_wx_jje%252Fwm&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 259056 INFO (OverseerThreadFactory-793-thread-5) [ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38178_wx_jje%2Fwm for creating new replica
[junit4] 2> 259061 INFO (qtp97481626-1743) [n:127.0.0.1:38178_wx_jje%2Fwm x:collection1_shard1_replica_t65] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 260095 INFO (qtp97481626-1743) [n:127.0.0.1:38178_wx_jje%2Fwm c:collection1 s:shard1 x:collection1_shard1_replica_t65] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 260107 INFO (qtp97481626-1743) [n:127.0.0.1:38178_wx_jje%2Fwm c:collection1 s:shard1 x:collection1_shard1_replica_t65] o.a.s.s.IndexSchema [collection1_shard1_replica_t65] Schema name=test
[junit4] 2> 260372 INFO (qtp97481626-1743) [n:127.0.0.1:38178_wx_jje%2Fwm c:collection1 s:shard1 x:collection1_shard1_replica_t65] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 260399 INFO (qtp97481626-1743) [n:127.0.0.1:38178_wx_jje%2Fwm c:collection1 s:shard1 x:collection1_shard1_replica_t65] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t65' using configuration from collection collection1, trusted=true
[junit4] 2> 260399 INFO (qtp97481626-1743) [n:127.0.0.1:38178_wx_jje%2Fwm c:collection1 s:shard1 x:collection1_shard1_replica_t65] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t65' (registry 'solr.core.collection1.shard1.replica_t65') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24048d84
[junit4] 2> 260399 INFO (qtp97481626-1
[...truncated too long message...]
s.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=8A2193AFFD97F591 -Dtests.slow=true -Dtests.locale=it-IT -Dtests.timezone=Africa/Addis_Ababa -Dtests.asserts=true -Dtests.file.encoding=UTF-8
Buildfile: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/build.xml
-clover.disable:
ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/top-level-ivy-settings.xml
install-junit4-taskdef:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 16ms :: artifacts dl 0ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 1 | 0 | 0 | 0 || 1 | 0 |
---------------------------------------------------------------------
-init-totals:
-test:
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 8A2193AFFD97F591
[mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/temp
[junit4] <JUnit4> says aloha! Master seed: 8A2193AFFD97F591
[junit4] Executing 5 suites with 2 JVMs.
[junit4]
[junit4] Started J0 PID(24144@serv1-vm3).
[junit4] Started J1 PID(24145@serv1-vm3).
[junit4] HEARTBEAT J1 PID(24145@serv1-vm3): 2018-07-19T20:31:51, stalled for 68.7s at: ChaosMonkeyNothingIsSafeTest.test
[junit4] HEARTBEAT J0 PID(24144@serv1-vm3): 2018-07-19T20:31:51, stalled for 69.0s at: ChaosMonkeyNothingIsSafeTest.test
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] OK 65.1s J1 | ChaosMonkeyNothingIsSafeTest.test
[junit4] Completed [1/5] on J1 in 88.44s, 1 test
[junit4]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] OK 65.2s J0 | ChaosMonkeyNothingIsSafeTest.test
[junit4] Completed [2/5] on J0 in 88.98s, 1 test
[junit4]
[junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
[junit4] HEARTBEAT J0 PID(24144@serv1-vm3): 2018-07-19T20:33:15, stalled for 65.4s at: ChaosMonkeyNothingIsSafeTest.test
[junit4] HEARTBEAT J1 PID(24145@serv1-vm3): 2018-07-19T20:33:15, stalled for 65.7s at: ChaosMonkeyNothingIsSafeTest.test
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] OK 56.8s J1 | ChaosMonkeyNothingIsSafeTest.test
[junit4] Completed [3/5] on J1 in 78.19s, 1 test
[junit4]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] OK 57.1s J0 | ChaosMonkeyNothingIsSafeTest.test
[junit4] Completed [4/5] on J0 in 79.20s, 1 test
[junit4]
[junit4] HEARTBEAT J1 PID(24145@serv1-vm3): 2018-07-19T20:34:39, stalled for 71.2s at: ChaosMonkeyNothingIsSafeTest.test
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] OK 59.1s J1 | ChaosMonkeyNothingIsSafeTest.test
[junit4] Completed [5/5] on J1 in 80.78s, 1 test
[junit4]
[junit4] JVM J0: 0.72 .. 170.22 = 169.50s
[junit4] JVM J1: 0.73 .. 249.85 = 249.12s
[junit4] Execution time total: 4 minutes 9 seconds
[junit4] Tests summary: 5 suites, 5 tests
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp])
[junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp])
[echo] 5 slowest tests:
[junit4:tophints] 116.21s | org.apache.solr.cloud.ZkFailoverTest
[junit4:tophints] 100.22s | org.apache.solr.cloud.MetricsHistoryIntegrationTest
[junit4:tophints] 91.44s | org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4:tophints] 76.60s | org.apache.solr.cloud.OverseerTest
[junit4:tophints] 70.36s | org.apache.solr.cloud.ReplicationFactorTest
-check-totals:
test-nocompile:
BUILD SUCCESSFUL
Total time: 4 minutes 12 seconds
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2843)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2722)
at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2703)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3082)
Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
at hudson.remoting.Channel.call(Channel.java:955)
at hudson.FilePath.act(FilePath.java:1089)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084)
at hudson.remoting.UserRequest.perform(UserRequest.java:212)
at hudson.remoting.UserRequest.perform(UserRequest.java:54)
at hudson.remoting.Request$2.run(Request.java:369)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
at hudson.FilePath.act(FilePath.java:1091)
at hudson.FilePath.act(FilePath.java:1078)
at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1840)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=524d1157c711f5f0b2c1c62528c401d028ff5278, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #732
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2