You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/08/18 14:37:50 UTC
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 119 -
Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/119/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=33647, name=jetty-launcher-5459-thread-2-SendThread(127.0.0.1:61976), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 2) Thread[id=33572, name=jetty-launcher-5459-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 3) Thread[id=33648, name=jetty-launcher-5459-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=33647, name=jetty-launcher-5459-thread-2-SendThread(127.0.0.1:61976), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
2) Thread[id=33572, name=jetty-launcher-5459-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
3) Thread[id=33648, name=jetty-launcher-5459-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
at __randomizedtesting.SeedInfo.seed([5931498DB2FCC92F]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=33647, name=jetty-launcher-5459-thread-2-SendThread(127.0.0.1:61976), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=33647, name=jetty-launcher-5459-thread-2-SendThread(127.0.0.1:61976), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
at __randomizedtesting.SeedInfo.seed([5931498DB2FCC92F]:0)
FAILED: org.apache.solr.cloud.TestPullReplica.testKillLeader
Error Message:
Replica state not updated in cluster state null Live Nodes: [127.0.0.1:63468_solr, 127.0.0.1:38429_solr] Last available state: DocCollection(pull_replica_test_kill_leader//collections/pull_replica_test_kill_leader/state.json/6)={ "pullReplicas":"1", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"pull_replica_test_kill_leader_shard1_replica_n1", "base_url":"http://127.0.0.1:63468/solr", "node_name":"127.0.0.1:63468_solr", "state":"down", "type":"NRT", "leader":"true"}, "core_node4":{ "core":"pull_replica_test_kill_leader_shard1_replica_p2", "base_url":"http://127.0.0.1:38429/solr", "node_name":"127.0.0.1:38429_solr", "state":"active", "type":"PULL"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"100", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Replica state not updated in cluster state
null
Live Nodes: [127.0.0.1:63468_solr, 127.0.0.1:38429_solr]
Last available state: DocCollection(pull_replica_test_kill_leader//collections/pull_replica_test_kill_leader/state.json/6)={
"pullReplicas":"1",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"pull_replica_test_kill_leader_shard1_replica_n1",
"base_url":"http://127.0.0.1:63468/solr",
"node_name":"127.0.0.1:63468_solr",
"state":"down",
"type":"NRT",
"leader":"true"},
"core_node4":{
"core":"pull_replica_test_kill_leader_shard1_replica_p2",
"base_url":"http://127.0.0.1:38429/solr",
"node_name":"127.0.0.1:38429_solr",
"state":"active",
"type":"PULL"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"100",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([5931498DB2FCC92F:1027BD39D0475D79]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.TestPullReplica.doTestNoLeader(TestPullReplica.java:401)
at org.apache.solr.cloud.TestPullReplica.testKillLeader(TestPullReplica.java:290)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12468 lines...]
[junit4] Suite: org.apache.solr.cloud.TestPullReplica
[junit4] 2> 2738010 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/init-core-data-001
[junit4] 2> 2738011 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2738012 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2738012 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001
[junit4] 2> 2738012 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2738012 INFO (Thread-8096) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2738012 INFO (Thread-8096) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2738013 ERROR (Thread-8096) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2738112 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:57935
[junit4] 2> 2738127 INFO (jetty-launcher-5389-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2738127 INFO (jetty-launcher-5389-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2738129 INFO (jetty-launcher-5389-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2f015f13{/solr,null,AVAILABLE}
[junit4] 2> 2738129 INFO (jetty-launcher-5389-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1fec2bac{HTTP/1.1,[http/1.1]}{127.0.0.1:38429}
[junit4] 2> 2738129 INFO (jetty-launcher-5389-thread-1) [ ] o.e.j.s.Server Started @2740971ms
[junit4] 2> 2738129 INFO (jetty-launcher-5389-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38429}
[junit4] 2> 2738129 ERROR (jetty-launcher-5389-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2738130 INFO (jetty-launcher-5389-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 2738130 INFO (jetty-launcher-5389-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2738130 INFO (jetty-launcher-5389-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2738130 INFO (jetty-launcher-5389-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-18T14:14:48.636Z
[junit4] 2> 2738135 INFO (jetty-launcher-5389-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@101172c4{/solr,null,AVAILABLE}
[junit4] 2> 2738135 INFO (jetty-launcher-5389-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3d084c58{HTTP/1.1,[http/1.1]}{127.0.0.1:63468}
[junit4] 2> 2738135 INFO (jetty-launcher-5389-thread-2) [ ] o.e.j.s.Server Started @2740977ms
[junit4] 2> 2738135 INFO (jetty-launcher-5389-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63468}
[junit4] 2> 2738135 ERROR (jetty-launcher-5389-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2738136 INFO (jetty-launcher-5389-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 2738136 INFO (jetty-launcher-5389-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2738136 INFO (jetty-launcher-5389-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2738136 INFO (jetty-launcher-5389-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-18T14:14:48.642Z
[junit4] 2> 2738138 INFO (jetty-launcher-5389-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2738138 INFO (jetty-launcher-5389-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2738144 INFO (jetty-launcher-5389-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57935/solr
[junit4] 2> 2738144 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15df5b249c70001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2738145 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15df5b249c70002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2738145 INFO (jetty-launcher-5389-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57935/solr
[junit4] 2> 2738281 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2738282 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38429_solr
[junit4] 2> 2738284 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.c.Overseer Overseer (id=98504912962781189-127.0.0.1:38429_solr-n_0000000000) starting
[junit4] 2> 2738298 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38429_solr
[junit4] 2> 2738301 INFO (zkCallback-5400-thread-1-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2738315 INFO (jetty-launcher-5389-thread-2) [n:127.0.0.1:63468_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2738321 INFO (jetty-launcher-5389-thread-2) [n:127.0.0.1:63468_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2738326 INFO (jetty-launcher-5389-thread-2) [n:127.0.0.1:63468_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63468_solr
[junit4] 2> 2738328 INFO (zkCallback-5401-thread-1-processing-n:127.0.0.1:63468_solr) [n:127.0.0.1:63468_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2738333 INFO (zkCallback-5400-thread-1-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2738462 INFO (jetty-launcher-5389-thread-2) [n:127.0.0.1:63468_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63468.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2738463 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38429.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2738470 INFO (jetty-launcher-5389-thread-2) [n:127.0.0.1:63468_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63468.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2738470 INFO (jetty-launcher-5389-thread-2) [n:127.0.0.1:63468_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63468.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2738470 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38429.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2738470 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38429.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2738471 INFO (jetty-launcher-5389-thread-1) [n:127.0.0.1:38429_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/.
[junit4] 2> 2738471 INFO (jetty-launcher-5389-thread-2) [n:127.0.0.1:63468_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/.
[junit4] 2> 2738506 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2738508 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57935/solr ready
[junit4] 2> 2738512 INFO (SUITE-TestPullReplica-seed#[5931498DB2FCC92F]-worker) [ ] o.a.s.c.TestPullReplica Using legacyCloud?: false
[junit4] 2> 2738513 INFO (qtp1757047768-32912) [n:127.0.0.1:63468_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2738514 INFO (qtp1757047768-32912) [n:127.0.0.1:63468_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 2738623 INFO (TEST-TestPullReplica.testCreateDelete-seed#[5931498DB2FCC92F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateDelete { seed=[5931498DB2FCC92F:4221B8C1440C311F]}
[junit4] 2> 2738625 INFO (qtp1274872603-32900) [n:127.0.0.1:38429_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=3&replicationFactor=1&collection.configName=conf&maxShardsPerNode=100&name=pull_replica_test_create_delete&action=CREATE&numShards=2 and sendToOCPQueue=true
[junit4] 2> 2738629 INFO (OverseerThreadFactory-12717-thread-1-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.CreateCollectionCmd Create collection pull_replica_test_create_delete
[junit4] 2> 2738630 WARN (OverseerThreadFactory-12717-thread-1-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 4 on collection pull_replica_test_create_delete is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 2738742 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63468/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2738746 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_p2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38429/solr",
[junit4] 2> "type":"PULL"}
[junit4] 2> 2738755 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_p4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63468/solr",
[junit4] 2> "type":"PULL"}
[junit4] 2> 2738759 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_p6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38429/solr",
[junit4] 2> "type":"PULL"}
[junit4] 2> 2738763 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_n8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63468/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2738768 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_p10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38429/solr",
[junit4] 2> "type":"PULL"}
[junit4] 2> 2738771 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_p12",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63468/solr",
[junit4] 2> "type":"PULL"}
[junit4] 2> 2738774 INFO (OverseerStateUpdate-98504912962781189-127.0.0.1:38429_solr-n_0000000000) [n:127.0.0.1:38429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_p14",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38429/solr",
[junit4] 2> "type":"PULL"}
[junit4] 2> 2738977 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p6&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 2738977 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p4&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 2738977 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2738977 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2738977 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_n1&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2738978 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p10&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 2738986 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p2&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 2738986 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p14&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 2738986 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_n8&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2738987 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p12&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 2739097 INFO (zkCallback-5400-thread-1-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2739098 INFO (zkCallback-5401-thread-1-processing-n:127.0.0.1:63468_solr) [n:127.0.0.1:63468_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2739098 INFO (zkCallback-5400-thread-2-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2739098 INFO (zkCallback-5401-thread-2-processing-n:127.0.0.1:63468_solr) [n:127.0.0.1:63468_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2739996 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2739997 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2740002 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2740003 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2740017 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_p6] Schema name=minimal
[junit4] 2> 2740017 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2740018 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_p4] Schema name=minimal
[junit4] 2> 2740019 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740019 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_p6' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740019 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38429.solr.core.pull_replica_test_create_delete.shard1.replica_p6' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_p6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740020 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740020 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_p6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/pull_replica_test_create_delete_shard1_replica_p6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/./pull_replica_test_create_delete_shard1_replica_p6/data/]
[junit4] 2> 2740020 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740020 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_p4' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740020 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63468.solr.core.pull_replica_test_create_delete.shard1.replica_p4' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740020 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740019 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740020 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_n1' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740020 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_p4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/pull_replica_test_create_delete_shard1_replica_p4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/./pull_replica_test_create_delete_shard1_replica_p4/data/]
[junit4] 2> 2740021 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63468.solr.core.pull_replica_test_create_delete.shard1.replica_n1' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740021 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740021 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/pull_replica_test_create_delete_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/./pull_replica_test_create_delete_shard1_replica_n1/data/]
[junit4] 2> 2740028 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_p10] Schema name=minimal
[junit4] 2> 2740029 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740029 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_p10' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740030 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38429.solr.core.pull_replica_test_create_delete.shard2.replica_p10' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_p10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740030 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740030 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_p10] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/pull_replica_test_create_delete_shard2_replica_p10], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/./pull_replica_test_create_delete_shard2_replica_p10/data/]
[junit4] 2> 2740031 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2740047 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2740047 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2740068 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_n8] Schema name=minimal
[junit4] 2> 2740068 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_p2] Schema name=minimal
[junit4] 2> 2740069 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740069 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_n8' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740069 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740069 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63468.solr.core.pull_replica_test_create_delete.shard2.replica_n8' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740069 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740069 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_p2' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740069 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_n8] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/pull_replica_test_create_delete_shard2_replica_n8], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/./pull_replica_test_create_delete_shard2_replica_n8/data/]
[junit4] 2> 2740069 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38429.solr.core.pull_replica_test_create_delete.shard1.replica_p2' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_p2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740069 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740069 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_p2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/pull_replica_test_create_delete_shard1_replica_p2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/./pull_replica_test_create_delete_shard1_replica_p2/data/]
[junit4] 2> 2740083 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_p12] Schema name=minimal
[junit4] 2> 2740084 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740084 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_p12' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740085 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63468.solr.core.pull_replica_test_create_delete.shard2.replica_p12' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_p12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740085 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740085 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_p12] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/pull_replica_test_create_delete_shard2_replica_p12], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node2/./pull_replica_test_create_delete_shard2_replica_p12/data/]
[junit4] 2> 2740085 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2740109 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_p14] Schema name=minimal
[junit4] 2> 2740111 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2740111 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_p14' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 2740111 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38429.solr.core.pull_replica_test_create_delete.shard2.replica_p14' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_p14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b43910f
[junit4] 2> 2740111 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2740112 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_p14] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/pull_replica_test_create_delete_shard2_replica_p14], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_5931498DB2FCC92F-001/tempDir-001/node1/./pull_replica_test_create_delete_shard2_replica_p14/data/]
[junit4] 2> 2740131 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740132 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740133 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.s.SolrIndexSearcher Opening [Searcher@32fb9ad2[pull_replica_test_create_delete_shard2_replica_p10] main]
[junit4] 2> 2740150 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740151 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740153 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740154 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.c.ZkController pull_replica_test_create_delete_shard2_replica_p10 starting background replication from leader
[junit4] 2> 2740154 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 2740155 INFO (qtp1274872603-32902) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 2740176 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2740176 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2740178 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740178 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740179 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6f59a076[pull_replica_test_create_delete_shard1_replica_n1] main]
[junit4] 2> 2740180 INFO (searcherExecutor-12725-thread-1-processing-n:127.0.0.1:38429_solr x:pull_replica_test_create_delete_shard2_replica_p10 s:shard2 c:pull_replica_test_create_delete r:core_node13) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_p10] Registered new searcher Searcher@32fb9ad2[pull_replica_test_create_delete_shard2_replica_p10] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740182 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740182 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740183 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740183 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576078609679908864
[junit4] 2> 2740184 INFO (searcherExecutor-12724-thread-1-processing-n:127.0.0.1:63468_solr x:pull_replica_test_create_delete_shard1_replica_n1 s:shard1 c:pull_replica_test_create_delete r:core_node3) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_n1] Registered new searcher Searcher@6f59a076[pull_replica_test_create_delete_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740196 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740196 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740197 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@74418900[pull_replica_test_create_delete_shard1_replica_p4] main]
[junit4] 2> 2740199 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2740199 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2740199 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:63468/solr/pull_replica_test_create_delete_shard1_replica_n1/
[junit4] 2> 2740199 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2740199 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740199 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:63468/solr/pull_replica_test_create_delete_shard1_replica_n1/ has no replicas
[junit4] 2> 2740200 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2740200 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740204 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740204 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2740205 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2740205 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.ZkController pull_replica_test_create_delete_shard1_replica_p4 starting background replication from leader
[junit4] 2> 2740205 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:63468/solr/pull_replica_test_create_delete_shard1_replica_n1/ shard1
[junit4] 2> 2740205 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 2740206 INFO (searcherExecutor-12723-thread-1-processing-n:127.0.0.1:63468_solr x:pull_replica_test_create_delete_shard1_replica_p4 s:shard1 c:pull_replica_test_create_delete r:core_node7) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_p4] Registered new searcher Searcher@74418900[pull_replica_test_create_delete_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740207 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 2740208 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740208 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740209 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.s.SolrIndexSearcher Opening [Searcher@5d8c757d[pull_replica_test_create_delete_shard2_replica_n8] main]
[junit4] 2> 2740211 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740211 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740212 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740212 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740212 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740212 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576078609710317568
[junit4] 2> 2740213 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.s.SolrIndexSearcher Opening [Searcher@8b587a2[pull_replica_test_create_delete_shard1_replica_p6] main]
[junit4] 2> 2740213 INFO (searcherExecutor-12726-thread-1-processing-n:127.0.0.1:63468_solr x:pull_replica_test_create_delete_shard2_replica_n8 s:shard2 c:pull_replica_test_create_delete r:core_node11) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_n8] Registered new searcher Searcher@5d8c757d[pull_replica_test_create_delete_shard2_replica_n8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740218 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740222 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2740222 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2740222 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:63468/solr/pull_replica_test_create_delete_shard2_replica_n8/
[junit4] 2> 2740222 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2740222 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.SyncStrategy http://127.0.0.1:63468/solr/pull_replica_test_create_delete_shard2_replica_n8/ has no replicas
[junit4] 2> 2740222 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740224 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740223 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740225 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740226 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.c.ZkController pull_replica_test_create_delete_shard1_replica_p6 starting background replication from leader
[junit4] 2> 2740226 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 2740227 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 2740223 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2740230 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.s.SolrIndexSearcher Opening [Searcher@57c01515[pull_replica_test_create_delete_shard2_replica_p12] main]
[junit4] 2> 2740232 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740232 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740232 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740233 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.c.ZkController pull_replica_test_create_delete_shard2_replica_p12 starting background replication from leader
[junit4] 2> 2740233 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 2740234 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 2740238 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:63468/solr/pull_replica_test_create_delete_shard2_replica_n8/ shard2
[junit4] 2> 2740242 INFO (searcherExecutor-12728-thread-1-processing-n:127.0.0.1:63468_solr x:pull_replica_test_create_delete_shard2_replica_p12 s:shard2 c:pull_replica_test_create_delete r:core_node15) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_p12] Registered new searcher Searcher@57c01515[pull_replica_test_create_delete_shard2_replica_p12] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740242 INFO (searcherExecutor-12722-thread-1-processing-n:127.0.0.1:38429_solr x:pull_replica_test_create_delete_shard1_replica_p6 s:shard1 c:pull_replica_test_create_delete r:core_node9) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_p6] Registered new searcher Searcher@8b587a2[pull_replica_test_create_delete_shard1_replica_p6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740245 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740245 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740246 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.SolrIndexSearcher Opening [Searcher@4fc5893f[pull_replica_test_create_delete_shard1_replica_p2] main]
[junit4] 2> 2740248 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740249 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740249 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740250 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.ZkController pull_replica_test_create_delete_shard1_replica_p2 starting background replication from leader
[junit4] 2> 2740250 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 2740250 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2740250 INFO (searcherExecutor-12727-thread-1-processing-n:127.0.0.1:38429_solr x:pull_replica_test_create_delete_shard1_replica_p2 s:shard1 c:pull_replica_test_create_delete r:core_node5) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_p2] Registered new searcher Searcher@4fc5893f[pull_replica_test_create_delete_shard1_replica_p2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740250 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2740251 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 2740252 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.SolrIndexSearcher Opening [Searcher@3555c6d9[pull_replica_test_create_delete_shard2_replica_p14] main]
[junit4] 2> 2740257 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2740258 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2740259 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2740259 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.ZkController pull_replica_test_create_delete_shard2_replica_p14 starting background replication from leader
[junit4] 2> 2740259 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 2740260 INFO (searcherExecutor-12730-thread-1-processing-n:127.0.0.1:38429_solr x:pull_replica_test_create_delete_shard2_replica_p14 s:shard2 c:pull_replica_test_create_delete r:core_node16) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_p14] Registered new searcher Searcher@3555c6d9[pull_replica_test_create_delete_shard2_replica_p14] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2740260 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 2740339 INFO (zkCallback-5400-thread-2-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2740339 INFO (zkCallback-5400-thread-1-processing-n:127.0.0.1:38429_solr) [n:127.0.0.1:38429_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2740339 INFO (zkCallback-5401-thread-1-processing-n:127.0.0.1:63468_solr) [n:127.0.0.1:63468_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2740339 INFO (zkCallback-5401-thread-2-processing-n:127.0.0.1:63468_solr) [n:127.0.0.1:63468_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2740354 INFO (qtp1274872603-32903) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p2&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1369
[junit4] 2> 2740357 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2740358 INFO (indexFetcher-12747-thread-1) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
[junit4] 2> 2740359 INFO (qtp1757047768-32914) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node3 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_n1&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1381
[junit4] 2> 2740359 INFO (indexFetcher-12736-thread-1) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p10] o.a.s.h.IndexFetcher Replica core_node11 is leader but it's state is down, skipping replication
[junit4] 2> 2740360 INFO (qtp1757047768-32911) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p4&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1383
[junit4] 2> 2740364 INFO (qtp1274872603-32904) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p14&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1377
[junit4] 2> 2740376 INFO (indexFetcher-12756-thread-1) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
[junit4] 2> 2740379 INFO (qtp1274872603-32901) [n:127.0.0.1:38429_solr c:pull_replica_test_create_delete s:shard1 r:core_node9 x:pull_replica_test_create_delete_shard1_replica_p6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p6&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1402
[junit4] 2> 2740388 INFO (indexFetcher-12759-thread-1) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.h.IndexFetcher Replica core_node11 is leader but it's state is down, skipping replication
[junit4] 2> 2740388 INFO (qtp1757047768-32916) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p12] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p12&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1401
[junit4] 2> 2740389 INFO (qtp1757047768-32913) [n:127.0.0.1:63468_solr c:pull_replica_test_create_delete s:shard2 r:core_node11 x:pull_replica_test_create_delete_shard2_replica_n8] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2>
[...truncated too long message...]
lrCLIZkUtilsTest, TestRandomFaceting, TestDownShardTolerantSearch, OpenExchangeRatesOrgProviderTest, QueryEqualityTest, TestDefaultStatsCache, SynonymTokenizerTest, UpdateParamsTest, SuggesterFSTTest, TestPayloadScoreQParserPlugin, TestQueryUtils, OpenCloseCoreStressTest, DistributedQueryElevationComponentTest, TestDocTermOrds, TestCollationFieldDocValues, LukeRequestHandlerTest, TestLegacyField, DocumentAnalysisRequestHandlerTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestStressUserVersions, TestXmlQParser, TestRawTransformer, TestStressCloudBlindAtomicUpdates, SubstringBytesRefFilterTest, TestDynamicLoading, QueryResultKeyTest, TestFileDictionaryLookup, TestConfigsApi, PropertiesRequestHandlerTest, RuleEngineTest, TestFieldCacheSortRandom, LeaderInitiatedRecoveryOnShardRestartTest, TestHdfsCloudBackupRestore, CollectionsAPIDistributedZkTest, SolrGraphiteReporterTest, TestCharFilters, TestCSVLoader, BadCopyFieldTest, TestBM25SimilarityFactory, TestBadConfig, TestJsonRequest, HdfsRecoveryZkTest, TestExactSharedStatsCache, DistributedSuggestComponentTest, HdfsBasicDistributedZkTest, TestSortByMinMaxFunction, TermVectorComponentTest, HdfsDirectoryTest, DistribJoinFromCollectionTest, DeleteNodeTest, CopyFieldTest, TestMultiWordSynonyms, TestSubQueryTransformerCrossCore, TestNRTOpen, TermVectorComponentDistributedTest, TestDistributedStatsComponentCardinality, TemplateUpdateProcessorTest, DistributedVersionInfoTest, FieldMutatingUpdateProcessorTest, AnalysisErrorHandlingTest, SolrIndexConfigTest, TestRestManager, BasicZkTest, PluginInfoTest, TestManagedSchemaThreadSafety, TestValueSourceCache, PreAnalyzedFieldTest, DeleteShardTest, DistributedDebugComponentTest, CreateCollectionCleanupTest, LeaderElectionIntegrationTest, LoggingHandlerTest, TestSchemaManager, VMParamsZkACLAndCredentialsProvidersTest, TestRangeQuery, TestElisionMultitermQuery, TestFieldCacheReopen, InfoHandlerTest, FullHLLTest, DOMUtilTest, MultiThreadedOCPTest, TestOverriddenPrefixQueryForCustomFieldType, TestSchemaResource, TestCorePropertiesReload, OverseerTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler, ClusterStateUpdateTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, ShardRoutingCustomTest, TestDistributedSearch, AutoCommitTest, TestDistributedGrouping, TestFaceting, TestRecovery, TestJoin, TestReload, HardAutoCommitTest, DistributedTermsComponentTest, TestCoreContainer, SolrCoreTest, StatsComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestLazyCores, DirectUpdateHandlerTest, ShowFileRequestHandlerTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesTest, SuggesterTSTTest, TestTrie, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, TestRemoteStreaming, SolrInfoBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, RequestHandlersTest, DocumentBuilderTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, TestJmxIntegration, TestCollationField, TestCSVResponseWriter, BinaryUpdateRequestHandlerTest, PingRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, TestLFUCache, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, TestQuerySenderNoQuery, TestStressRecovery, TestMergePolicyConfig, TestSolrDeletionPolicy2, SampleTest, TestDocSet, MinimalSchemaTest, TestConfig, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestFastWriter, ResourceLoaderTest, TestFastOutputStream, TestFastLRUCache, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, TestSolrJ, TestLRUCache, ZkNodePropsTest, FileUtilsTest, TestRTGBase, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestHighlightDedupGrouping, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ConnectionReuseTest, ActionThrottleTest, AssignTest, CleanupOldIndexTest, CollectionReloadTest, CollectionTooManyReplicasTest, CollectionsAPISolrJTest, DistribDocExpirationUpdateProcessorTest, LeaderElectionContextKeyTest, LeaderInitiatedRecoveryOnCommitTest, MissingSegmentRecoveryTest, MoveReplicaHDFSTest, MoveReplicaHDFSUlogDirTest, NodeMutatorTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, OverseerStatusTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, ReplaceNodeTest, SSLMigrationTest, ShardSplitTest, TestLocalFSCloudBackupRestore, TestLockTree, TestPullReplica, TestSegmentSorting, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=5931498DB2FCC92F -Dtests.slow=true -Dtests.locale=uk-UA -Dtests.timezone=Africa/Maseru -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=33647, name=jetty-launcher-5459-thread-2-SendThread(127.0.0.1:61976), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 2) Thread[id=33572, name=jetty-launcher-5459-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > 3) Thread[id=33648, name=jetty-launcher-5459-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] > at __randomizedtesting.SeedInfo.seed([5931498DB2FCC92F]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=33647, name=jetty-launcher-5459-thread-2-SendThread(127.0.0.1:61976), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > at __randomizedtesting.SeedInfo.seed([5931498DB2FCC92F]:0)
[junit4] Completed [550/729 (2!)] on J1 in 57.86s, 12 tests, 2 errors <<< FAILURES!
[...truncated 43930 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 123 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/123/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitWithChaosMonkey
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([9D9B6B2DEBD2B6E2:16BCB8FCAAD41D66]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:908)
at org.apache.solr.cloud.ShardSplitTest.testSplitWithChaosMonkey(ShardSplitTest.java:436)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11700 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/init-core-data-001
[junit4] 2> 1376514 INFO (SUITE-ShardSplitTest-seed#[9D9B6B2DEBD2B6E2]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1376515 INFO (SUITE-ShardSplitTest-seed#[9D9B6B2DEBD2B6E2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1376515 INFO (SUITE-ShardSplitTest-seed#[9D9B6B2DEBD2B6E2]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1376515 INFO (SUITE-ShardSplitTest-seed#[9D9B6B2DEBD2B6E2]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /x/
[junit4] 2> 1376517 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1376517 INFO (Thread-2494) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1376517 INFO (Thread-2494) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1376519 ERROR (Thread-2494) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1376617 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkTestServer start zk server on port:62943
[junit4] 2> 1376651 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1376657 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1376661 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1376665 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1376669 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1376673 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1376676 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1376680 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1376682 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1376686 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1376688 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1376691 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 1376803 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1376804 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b8b8d66{/x,null,AVAILABLE}
[junit4] 2> 1376804 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@53267526{HTTP/1.1,[http/1.1]}{127.0.0.1:35251}
[junit4] 2> 1376804 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server Started @1379746ms
[junit4] 2> 1376805 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/tempDir-001/control/data, replicaType=NRT, hostContext=/x, hostPort=35251, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/control-001/cores}
[junit4] 2> 1376805 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1376805 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1376805 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1376805 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1376805 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-20T07:29:55.755Z
[junit4] 2> 1376808 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1376808 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/control-001/solr.xml
[junit4] 2> 1376811 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1376813 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62943/solr
[junit4] 2> 1376924 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1376925 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35251_x
[junit4] 2> 1376926 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.c.Overseer Overseer (id=98514645514256388-127.0.0.1:35251_x-n_0000000000) starting
[junit4] 2> 1376934 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35251_x
[junit4] 2> 1376936 INFO (OverseerStateUpdate-98514645514256388-127.0.0.1:35251_x-n_0000000000) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1377002 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1377009 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1377009 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1377010 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:35251_x ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/control-001/cores
[junit4] 2> 1377027 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1377028 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62943/solr ready
[junit4] 2> 1377031 INFO (qtp1859759596-15876) [n:127.0.0.1:35251_x ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35251_x&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1377035 INFO (OverseerThreadFactory-4622-thread-1-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1377146 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1377147 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1377259 INFO (zkCallback-3717-thread-1-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1378180 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1378201 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1378262 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1378283 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1378284 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1378284 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1378284 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1378286 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5259905720313058]
[junit4] 2> 1378298 WARN (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1378336 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1378336 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1378336 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1378336 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1378337 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1378337 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3109b8e7[control_collection_shard1_replica_n1] main]
[junit4] 2> 1378339 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1378339 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1378339 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1378340 INFO (searcherExecutor-4625-thread-1-processing-n:127.0.0.1:35251_x x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@3109b8e7[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1378340 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576234330137559040
[junit4] 2> 1378347 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1378347 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1378347 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35251/x/control_collection_shard1_replica_n1/
[junit4] 2> 1378347 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1378347 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35251/x/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1378347 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1378351 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35251/x/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1378464 INFO (zkCallback-3717-thread-1-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1378507 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1378510 INFO (qtp1859759596-15875) [n:127.0.0.1:35251_x c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1364
[junit4] 2> 1378517 INFO (qtp1859759596-15876) [n:127.0.0.1:35251_x ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1378619 INFO (zkCallback-3717-thread-1-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1379039 INFO (OverseerCollectionConfigSetProcessor-98514645514256388-127.0.0.1:35251_x-n_0000000000) [n:127.0.0.1:35251_x ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1379518 INFO (qtp1859759596-15876) [n:127.0.0.1:35251_x ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35251_x&wt=javabin&version=2} status=0 QTime=2487
[junit4] 2> 1379526 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1379528 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62943/solr ready
[junit4] 2> 1379528 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1379529 INFO (qtp1859759596-15880) [n:127.0.0.1:35251_x ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1379533 INFO (OverseerThreadFactory-4622-thread-2-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1379534 WARN (OverseerThreadFactory-4622-thread-2-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1379746 INFO (qtp1859759596-15880) [n:127.0.0.1:35251_x ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1379746 INFO (qtp1859759596-15880) [n:127.0.0.1:35251_x ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=216
[junit4] 2> 1379873 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-1-001 of type TLOG
[junit4] 2> 1379873 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1379874 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@73185997{/x,null,AVAILABLE}
[junit4] 2> 1379875 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@10931f94{HTTP/1.1,[http/1.1]}{127.0.0.1:56090}
[junit4] 2> 1379875 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server Started @1382818ms
[junit4] 2> 1379875 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/x, hostPort=56090, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-1-001/cores}
[junit4] 2> 1379876 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1379876 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1379876 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1379876 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1379876 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-20T07:29:58.826Z
[junit4] 2> 1379879 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1379879 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-1-001/solr.xml
[junit4] 2> 1379881 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1379884 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62943/solr
[junit4] 2> 1379894 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:56090_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1379896 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:56090_x ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1379899 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:56090_x ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56090_x
[junit4] 2> 1379901 INFO (zkCallback-3724-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1379901 INFO (zkCallback-3717-thread-2-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1379902 INFO (zkCallback-3729-thread-1-processing-n:127.0.0.1:56090_x) [n:127.0.0.1:56090_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1380008 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:56090_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1380015 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:56090_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1380015 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:56090_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1380016 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:56090_x ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-1-001/cores
[junit4] 2> 1380032 INFO (qtp1859759596-15873) [n:127.0.0.1:35251_x ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:56090_x&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1380036 INFO (OverseerThreadFactory-4622-thread-3-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:56090_x for creating new replica
[junit4] 2> 1380036 INFO (OverseerCollectionConfigSetProcessor-98514645514256388-127.0.0.1:35251_x-n_0000000000) [n:127.0.0.1:35251_x ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1380040 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1380041 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1381072 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1381087 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 1381138 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1381156 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 1381157 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1381157 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1381157 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 1381160 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5259905720313058]
[junit4] 2> 1381164 WARN (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1381200 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1381200 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1381201 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1381201 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1381202 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1381202 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@2026605d[collection1_shard2_replica_t41] main]
[junit4] 2> 1381204 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1381204 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1381205 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1381205 INFO (searcherExecutor-4636-thread-1-processing-n:127.0.0.1:56090_x x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@2026605d[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1381205 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576234333141729280
[junit4] 2> 1381213 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1381213 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1381213 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:56090/x/collection1_shard2_replica_t41/
[junit4] 2> 1381214 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1381214 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:56090/x/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 1381214 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1381215 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 1381219 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:56090/x/collection1_shard2_replica_t41/ shard2
[junit4] 2> 1381371 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1381372 INFO (qtp261830271-15916) [n:127.0.0.1:56090_x c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1332
[junit4] 2> 1381376 INFO (qtp1859759596-15873) [n:127.0.0.1:35251_x ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:56090_x&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1344
[junit4] 2> 1381495 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-2-001 of type TLOG
[junit4] 2> 1381496 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1381497 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39274897{/x,null,AVAILABLE}
[junit4] 2> 1381497 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@36e5b7d{HTTP/1.1,[http/1.1]}{127.0.0.1:61401}
[junit4] 2> 1381497 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server Started @1384441ms
[junit4] 2> 1381497 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/x, hostPort=61401, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-2-001/cores}
[junit4] 2> 1381498 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1381498 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1381498 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1381498 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1381498 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-20T07:30:00.448Z
[junit4] 2> 1381501 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1381501 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-2-001/solr.xml
[junit4] 2> 1381504 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1381506 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62943/solr
[junit4] 2> 1381516 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:61401_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1381519 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:61401_x ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1381521 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:61401_x ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61401_x
[junit4] 2> 1381523 INFO (zkCallback-3724-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1381524 INFO (zkCallback-3729-thread-1-processing-n:127.0.0.1:56090_x) [n:127.0.0.1:56090_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1381523 INFO (zkCallback-3717-thread-2-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1381525 INFO (zkCallback-3735-thread-1-processing-n:127.0.0.1:61401_x) [n:127.0.0.1:61401_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1381578 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:61401_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1381585 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:61401_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1381586 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:61401_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1381587 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:61401_x ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-2-001/cores
[junit4] 2> 1381611 INFO (qtp1192995790-15946) [n:127.0.0.1:61401_x ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:61401_x&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1381614 INFO (OverseerThreadFactory-4622-thread-4-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:61401_x for creating new replica
[junit4] 2> 1381614 INFO (OverseerCollectionConfigSetProcessor-98514645514256388-127.0.0.1:35251_x-n_0000000000) [n:127.0.0.1:35251_x ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1381617 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1381617 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1382644 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1382660 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 1382698 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1382716 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 1382716 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1382716 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1382716 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 1382718 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5259905720313058]
[junit4] 2> 1382722 WARN (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1382756 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1382756 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1382756 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1382756 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1382757 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1382757 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@6e2f5635[collection1_shard1_replica_t43] main]
[junit4] 2> 1382759 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1382760 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1382760 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1382761 INFO (searcherExecutor-4647-thread-1-processing-n:127.0.0.1:61401_x x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@6e2f5635[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1382761 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576234334773313536
[junit4] 2> 1382767 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1382767 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1382767 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61401/x/collection1_shard1_replica_t43/
[junit4] 2> 1382767 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1382768 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:61401/x/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 1382768 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1382768 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 1382772 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61401/x/collection1_shard1_replica_t43/ shard1
[junit4] 2> 1382923 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1382925 INFO (qtp1192995790-15948) [n:127.0.0.1:61401_x c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1308
[junit4] 2> 1382928 INFO (qtp1192995790-15946) [n:127.0.0.1:61401_x ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:61401_x&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1317
[junit4] 2> 1383051 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-3-001 of type TLOG
[junit4] 2> 1383051 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1383052 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@32c758b8{/x,null,AVAILABLE}
[junit4] 2> 1383052 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4e0b3160{HTTP/1.1,[http/1.1]}{127.0.0.1:46120}
[junit4] 2> 1383052 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server Started @1385997ms
[junit4] 2> 1383052 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/x, hostPort=46120, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-3-001/cores}
[junit4] 2> 1383053 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1383053 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1383053 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1383053 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1383053 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-20T07:30:02.003Z
[junit4] 2> 1383056 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1383056 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-3-001/solr.xml
[junit4] 2> 1383059 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1383061 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62943/solr
[junit4] 2> 1383073 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:46120_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1383076 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:46120_x ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1383078 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:46120_x ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46120_x
[junit4] 2> 1383080 INFO (zkCallback-3717-thread-2-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1383080 INFO (zkCallback-3729-thread-1-processing-n:127.0.0.1:56090_x) [n:127.0.0.1:56090_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1383081 INFO (zkCallback-3724-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1383081 INFO (zkCallback-3735-thread-1-processing-n:127.0.0.1:61401_x) [n:127.0.0.1:61401_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1383082 INFO (zkCallback-3741-thread-1-processing-n:127.0.0.1:46120_x) [n:127.0.0.1:46120_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1383200 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:46120_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1383207 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:46120_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1383208 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:46120_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1383209 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:46120_x ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-3-001/cores
[junit4] 2> 1383251 INFO (qtp1192995790-15949) [n:127.0.0.1:61401_x ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46120_x&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1383255 INFO (OverseerThreadFactory-4622-thread-5-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46120_x for creating new replica
[junit4] 2> 1383255 INFO (OverseerCollectionConfigSetProcessor-98514645514256388-127.0.0.1:35251_x-n_0000000000) [n:127.0.0.1:35251_x ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1383259 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1383260 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1384285 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1384302 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 1384340 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1384358 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 1384358 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1384358 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1384358 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 1384360 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5259905720313058]
[junit4] 2> 1384364 WARN (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1384399 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1384399 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1384400 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1384400 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1384401 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1384401 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@653a4085[collection1_shard2_replica_t45] main]
[junit4] 2> 1384402 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1384403 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1384403 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1384404 INFO (searcherExecutor-4658-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@653a4085[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1384404 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576234336496123904
[junit4] 2> 1384407 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
[junit4] 2> 1384408 INFO (qtp1659274426-15975) [n:127.0.0.1:46120_x c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1148
[junit4] 2> 1384408 INFO (updateExecutor-3738-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1384409 INFO (recoveryExecutor-3739-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1384409 INFO (qtp1192995790-15949) [n:127.0.0.1:61401_x ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46120_x&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1158
[junit4] 2> 1384410 INFO (recoveryExecutor-3739-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1384410 INFO (recoveryExecutor-3739-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
[junit4] 2> 1384411 INFO (recoveryExecutor-3739-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
[junit4] 2> 1384411 INFO (recoveryExecutor-3739-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1384411 INFO (recoveryExecutor-3739-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:56090/x/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:46120/x/collection1_shard2_replica_t45/]
[junit4] 2> 1384414 INFO (recoveryExecutor-3739-thread-1-processing-n:127.0.0.1:46120_x x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:46120_x c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:56090/x]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:46120_x&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1384416 INFO (qtp261830271-15919) [n:127.0.0.1:56090_x ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 1384416 INFO (qtp261830271-15919) [n:127.0.0.1:56090_x ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46120_x, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:46120/x","node_name":"127.0.0.1:46120_x","state":"down","type":"TLOG"}
[junit4] 2> 1384533 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-4-001 of type TLOG
[junit4] 2> 1384533 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1384534 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47419a78{/x,null,AVAILABLE}
[junit4] 2> 1384535 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ae6c0a2{HTTP/1.1,[http/1.1]}{127.0.0.1:39153}
[junit4] 2> 1384535 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.Server Started @1387479ms
[junit4] 2> 1384535 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/tempDir-001/jetty4, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/x, hostPort=39153, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-4-001/cores}
[junit4] 2> 1384536 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1384536 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1384536 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1384536 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1384536 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-20T07:30:03.486Z
[junit4] 2> 1384539 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1384539 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-4-001/solr.xml
[junit4] 2> 1384543 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1384545 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62943/solr
[junit4] 2> 1384555 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:39153_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1384558 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:39153_x ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1384560 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:39153_x ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39153_x
[junit4] 2> 1384561 INFO (zkCallback-3741-thread-1-processing-n:127.0.0.1:46120_x) [n:127.0.0.1:46120_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1384561 INFO (zkCallback-3735-thread-1-processing-n:127.0.0.1:61401_x) [n:127.0.0.1:61401_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1384561 INFO (zkCallback-3724-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1384562 INFO (zkCallback-3717-thread-2-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1384563 INFO (zkCallback-3729-thread-1-processing-n:127.0.0.1:56090_x) [n:127.0.0.1:56090_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1384563 INFO (zkCallback-3748-thread-1-processing-n:127.0.0.1:39153_x) [n:127.0.0.1:39153_x ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1384614 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:39153_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1384621 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:39153_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1384621 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:39153_x ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1384623 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[9D9B6B2DEBD2B6E2]) [n:127.0.0.1:39153_x ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-4-001/cores
[junit4] 2> 1384657 INFO (qtp1192995790-15951) [n:127.0.0.1:61401_x ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39153_x&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1384659 INFO (OverseerThreadFactory-4622-thread-5-processing-n:127.0.0.1:35251_x) [n:127.0.0.1:35251_x ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:39153_x for creating new replica
[junit4] 2> 1384660 INFO (OverseerCollectionConfigSetProcessor-98514645514256388-127.0.0.1:35251_x-n_0000000000) [n:127.0.0.1:35251_x ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1384665 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t47&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1384665 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1385490 INFO (qtp261830271-15919) [n:127.0.0.1:56090_x ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:46120_x, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:46120/x","node_name":"127.0.0.1:46120_x","state":"recovering","type":"TLOG"}
[junit4] 2> 1385490 INFO (qtp261830271-15919) [n:127.0.0.1:56090_x ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 1385491 INFO (qtp261830271-15919) [n:127.0.0.1:56090_x ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:46120_x&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1075
[junit4] 2> 1385694 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x c:collection1 s:shard1 x:collection1_shard1_replica_t47] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1385711 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x c:collection1 s:shard1 x:collection1_shard1_replica_t47] o.a.s.s.IndexSchema [collection1_shard1_replica_t47] Schema name=test
[junit4] 2> 1385761 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x c:collection1 s:shard1 x:collection1_shard1_replica_t47] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1385780 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x c:collection1 s:shard1 x:collection1_shard1_replica_t47] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t47' using configuration from collection collection1, trusted=true
[junit4] 2> 1385780 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x c:collection1 s:shard1 x:collection1_shard1_replica_t47] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t47' (registry 'solr.core.collection1.shard1.replica_t47') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dd6c2d1
[junit4] 2> 1385780 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x c:collection1 s:shard1 x:collection1_shard1_replica_t47] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1385780 INFO (qtp403433143-16008) [n:127.0.0.1:39153_x c:collection1 s:shard1 x:collection1_shard1_replica_t47] o.a.s.c.SolrCore [[collection1_shard1_replica_t47] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001/shard-4-001/cores/collection1_shard1_replica_t47], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/s
[...truncated too long message...]
com.codahale.metrics.MetricRegistry@6c31feed
[junit4] 2> 2032865 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2032866 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@bca71aa: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@c3a12eb
[junit4] 2> 2032871 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2032871 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3868b453: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7699f7d2
[junit4] 2> 2032874 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2032878 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:60516_x) [n:127.0.0.1:60516_x c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60516/x/collection1_shard1_replica_n47/
[junit4] 2> 2032878 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:60516_x) [n:127.0.0.1:60516_x c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.c.SyncStrategy We have been closed, won't sync with replicas
[junit4] 2> 2032878 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:60516_x) [n:127.0.0.1:60516_x c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2032878 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:60516_x) [n:127.0.0.1:60516_x c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.c.SolrCore [collection1_shard1_replica_n47] CLOSING SolrCore org.apache.solr.core.SolrCore@2d95b4ec
[junit4] 2> 2032878 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:60516_x) [n:127.0.0.1:60516_x c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n47, tag=764785900
[junit4] 2> 2032878 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:60516_x) [n:127.0.0.1:60516_x c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@784a4a42: rootName = null, domain = solr.core.collection1.shard1.replica_n47, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n47 / com.codahale.metrics.MetricRegistry@5b7c3ceb
[junit4] 2> 2032878 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.Overseer Overseer (id=98514686444240914-127.0.0.1:60516_x-n_0000000004) closing
[junit4] 2> 2032881 INFO (OverseerStateUpdate-98514686444240914-127.0.0.1:60516_x-n_0000000004) [n:127.0.0.1:60516_x ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60516_x
[junit4] 2> 2032887 INFO (zkCallback-3921-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2032897 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:60516_x) [n:127.0.0.1:60516_x c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=764785900
[junit4] 2> 2032902 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@2c6078e0{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2032903 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1a9d5bcb{/x,null,UNAVAILABLE}
[junit4] 2> 2032908 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 41278
[junit4] 2> 2032908 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2032909 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[9D9B6B2DEBD2B6E2]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53119 53119
[junit4] 2> 2042955 INFO (Thread-2728) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53119 53119
[junit4] 2> 2042957 WARN (Thread-2728) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/collections/collection1/state.json
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_9D9B6B2DEBD2B6E2-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=BlockTreeOrds(blocksize=128), shard_s=Lucene50(blocksize=128), a_t=Lucene50(blocksize=128), id=BlockTreeOrds(blocksize=128)}, docValues:{rnd_b=DocValuesFormat(name=Direct), shard_s=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Asserting), n_ti=DocValuesFormat(name=Lucene70), a_t=DocValuesFormat(name=Lucene70), a_i=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1774, maxMBSortInHeap=7.105659075205031, sim=RandomSimilarity(queryNorm=false): {}, locale=ca, timezone=America/Godthab
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_141 (64-bit)/cpus=3,threads=1,free=93993784,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestObjectReleaseTracker, LeaderInitiatedRecoveryOnShardRestartTest, RecoveryAfterSoftCommitTest, HdfsBasicDistributedZkTest, TestDeleteCollectionOnDownNodes, TestSolrCloudWithHadoopAuthPlugin, TestMergePolicyConfig, TestRuleBasedAuthorizationPlugin, TestFileDictionaryLookup, TestDistributedStatsComponentCardinality, RuleEngineTest, MissingSegmentRecoveryTest, TestZkChroot, TestPerFieldSimilarityWithDefaultOverride, IgnoreCommitOptimizeUpdateProcessorFactoryTest, PropertiesRequestHandlerTest, TestQueryTypes, DirectSolrSpellCheckerTest, DOMUtilTest, ChaosMonkeySafeLeaderTest, TestJsonFacetRefinement, SolrPluginUtilsTest, PreAnalyzedFieldTest, TestFastWriter, TestJettySolrRunner, TestCloudManagedSchema, HdfsNNFailoverTest, CoreAdminRequestStatusTest, TestCollationFieldDocValues, AddSchemaFieldsUpdateProcessorFactoryTest, CollectionsAPIDistributedZkTest, TestCrossCoreJoin, TestStressLucene, SpellCheckCollatorTest, ZkStateWriterTest, LeaderFailureAfterFreshStartTest, SchemaVersionSpecificBehaviorTest, DistributedTermsComponentTest, SimpleMLTQParserTest, SolrGraphiteReporterTest, DeleteNodeTest, TestDelegationWithHadoopAuth, TestSystemIdResolver, SolrIndexMetricsTest, SOLR749Test, TestSolrDeletionPolicy1, TestInPlaceUpdatesDistrib, TestFastLRUCache, TestSimpleTrackingShardHandler, MultiThreadedOCPTest, TestDocSet, TestHttpShardHandlerFactory, SolrRequestParserTest, BasicFunctionalityTest, TestStressUserVersions, DeleteInactiveReplicaTest, TestCloudNestedDocsSort, TestMiniSolrCloudClusterSSL, TestCoreDiscovery, TestScoreJoinQPNoScore, JSONWriterTest, ZkNodePropsTest, TestSlowCompositeReaderWrapper, ReplaceNodeTest, SegmentsInfoRequestHandlerTest, SuggestComponentContextFilterQueryTest, SolrIndexConfigTest, TestConfig, OverseerTaskQueueTest, TestFieldResource, SolrCmdDistributorTest, TestSolrJ, TestStressCloudBlindAtomicUpdates, TestWordDelimiterFilterFactory, ForceLeaderTest, OverseerCollectionConfigSetProcessorTest, TestUninvertingReader, TestRestManager, CollectionsAPISolrJTest, BlockDirectoryTest, TestRemoteStreaming, TestSimpleQParserPlugin, CdcrBootstrapTest, DocValuesMultiTest, TestPerFieldSimilarity, TermsComponentTest, ConvertedLegacyTest, TestLRUStatsCache, UpdateLogTest, TestIntervalFaceting, TestCopyFieldCollectionResource, TestHdfsCloudBackupRestore, TestSQLHandler, SuggesterTSTTest, TestStressLiveNodes, TestSizeLimitedDistributedMap, SignatureUpdateProcessorFactoryTest, ConfigSetsAPITest, TestSystemCollAutoCreate, CopyFieldTest, TestRandomFaceting, DistributedQueryElevationComponentTest, DistributedMLTComponentTest, TestDownShardTolerantSearch, TestConfigSetProperties, TestFastOutputStream, BadCopyFieldTest, CachingDirectoryFactoryTest, TestConfigSetsAPIZkFailure, TestMinMaxOnMultiValuedField, DistribCursorPagingTest, TestApiFramework, ShardSplitTest]
[junit4] Completed [298/729 (1!)] on J1 in 666.46s, 5 tests, 1 failure <<< FAILURES!
[...truncated 44812 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 122 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/122/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Doc with id=1 not found in http://127.0.0.1:36165/vz/ls/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:36165/vz/ls/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
at __randomizedtesting.SeedInfo.seed([2698F936505C811F:AECCC6ECFEA0ECE7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11680 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> 1552870 INFO (SUITE-HttpPartitionTest-seed#[2698F936505C811F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/init-core-data-001
[junit4] 2> 1552870 WARN (SUITE-HttpPartitionTest-seed#[2698F936505C811F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=67 numCloses=67
[junit4] 2> 1552871 INFO (SUITE-HttpPartitionTest-seed#[2698F936505C811F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1552872 INFO (SUITE-HttpPartitionTest-seed#[2698F936505C811F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1552872 INFO (SUITE-HttpPartitionTest-seed#[2698F936505C811F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /vz/ls
[junit4] 2> 1552873 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1552873 INFO (Thread-3390) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1552873 INFO (Thread-3390) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1552875 ERROR (Thread-3390) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1552973 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ZkTestServer start zk server on port:49606
[junit4] 2> 1552986 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1552988 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1552990 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1552993 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1553003 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1553005 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1553007 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1553008 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1553009 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1553010 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1553012 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1553014 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 1553135 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1553143 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70b5901{/vz/ls,null,AVAILABLE}
[junit4] 2> 1553145 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4569f13d{HTTP/1.1,[http/1.1]}{127.0.0.1:50499}
[junit4] 2> 1553145 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server Started @1556173ms
[junit4] 2> 1553145 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/tempDir-001/control/data, hostContext=/vz/ls, hostPort=59698, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/control-001/cores}
[junit4] 2> 1553145 ERROR (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1553145 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1553145 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1553145 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1553145 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T21:39:23.563Z
[junit4] 2> 1553148 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1553148 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/control-001/solr.xml
[junit4] 2> 1553151 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1553153 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49606/solr
[junit4] 2> 1553261 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1553261 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59698_vz%2Fls
[junit4] 2> 1553262 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.Overseer Overseer (id=98512323431104516-127.0.0.1:59698_vz%2Fls-n_0000000000) starting
[junit4] 2> 1553270 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59698_vz%2Fls
[junit4] 2> 1553272 INFO (zkCallback-1311-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1553350 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1553356 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1553356 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1553357 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/control-001/cores
[junit4] 2> 1553373 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1553374 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49606/solr ready
[junit4] 2> 1553375 INFO (SocketProxy-Acceptor-59698) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=48644,localport=59698], receiveBufferSize:130880
[junit4] 2> 1553378 INFO (SocketProxy-Acceptor-59698) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=50499,localport=59966], receiveBufferSize=139264
[junit4] 2> 1553380 INFO (qtp1620959804-12010) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:59698_vz%252Fls&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1553383 INFO (OverseerThreadFactory-3786-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1553490 INFO (SocketProxy-Acceptor-59698) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=52872,localport=59698], receiveBufferSize:130880
[junit4] 2> 1553491 INFO (SocketProxy-Acceptor-59698) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=50499,localport=50572], receiveBufferSize=139264
[junit4] 2> 1553492 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1553492 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1553605 INFO (zkCallback-1311-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1554508 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1554519 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1554586 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1554604 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1554605 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1554605 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1554605 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1554606 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=6.5302734375, floorSegmentMB=1.8095703125, forceMergeDeletesPctAllowed=21.5490129620436, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1554609 WARN (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1554645 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1554645 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1554646 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1554646 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1554647 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=83.3642578125, floorSegmentMB=1.6376953125, forceMergeDeletesPctAllowed=18.930821958232443, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1554647 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@690baa60[control_collection_shard1_replica_n1] main]
[junit4] 2> 1554649 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1554649 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1554649 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1554649 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576197176758894592
[junit4] 2> 1554650 INFO (searcherExecutor-3789-thread-1-processing-n:127.0.0.1:59698_vz%2Fls x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@690baa60[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1554657 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1554657 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1554657 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59698/vz/ls/control_collection_shard1_replica_n1/
[junit4] 2> 1554657 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1554657 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:59698/vz/ls/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1554657 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1554662 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59698/vz/ls/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1554769 INFO (zkCallback-1311-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1554814 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1554816 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1325
[junit4] 2> 1554820 INFO (qtp1620959804-12010) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1554922 INFO (zkCallback-1311-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1555395 INFO (OverseerCollectionConfigSetProcessor-98512323431104516-127.0.0.1:59698_vz%2Fls-n_0000000000) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1555822 INFO (qtp1620959804-12010) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:59698_vz%252Fls&wt=javabin&version=2} status=0 QTime=2443
[junit4] 2> 1555829 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1555831 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49606/solr ready
[junit4] 2> 1555831 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1555831 INFO (SocketProxy-Acceptor-59698) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=45881,localport=59698], receiveBufferSize:130880
[junit4] 2> 1555832 INFO (SocketProxy-Acceptor-59698) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=50499,localport=37132], receiveBufferSize=139264
[junit4] 2> 1555833 INFO (qtp1620959804-12014) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1555836 INFO (OverseerThreadFactory-3786-thread-2-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1555837 WARN (OverseerThreadFactory-3786-thread-2-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1556046 INFO (qtp1620959804-12014) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1556046 INFO (qtp1620959804-12014) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=212
[junit4] 2> 1556166 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-1-001 of type TLOG
[junit4] 2> 1556167 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1556168 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19065d0a{/vz/ls,null,AVAILABLE}
[junit4] 2> 1556168 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5bb7ced4{HTTP/1.1,[http/1.1]}{127.0.0.1:59590}
[junit4] 2> 1556168 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server Started @1559198ms
[junit4] 2> 1556168 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/vz/ls, hostPort=36165, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-1-001/cores}
[junit4] 2> 1556168 ERROR (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1556169 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1556169 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1556169 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1556169 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T21:39:26.587Z
[junit4] 2> 1556173 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1556173 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-1-001/solr.xml
[junit4] 2> 1556175 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1556178 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49606/solr
[junit4] 2> 1556193 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1556200 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1556203 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36165_vz%2Fls
[junit4] 2> 1556205 INFO (zkCallback-1318-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1556206 INFO (zkCallback-1311-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1556207 INFO (zkCallback-1323-thread-1-processing-n:127.0.0.1:36165_vz%2Fls) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1556399 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1556406 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1556406 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1556408 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-1-001/cores
[junit4] 2> 1556426 INFO (qtp1620959804-12007) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:36165_vz%252Fls&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1556432 INFO (OverseerThreadFactory-3786-thread-3-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:36165_vz%2Fls for creating new replica
[junit4] 2> 1556433 INFO (OverseerCollectionConfigSetProcessor-98512323431104516-127.0.0.1:59698_vz%2Fls-n_0000000000) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1556436 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=63887,localport=36165], receiveBufferSize:130880
[junit4] 2> 1556437 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=59590,localport=45799], receiveBufferSize=139264
[junit4] 2> 1556440 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1556441 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1557463 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1557472 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 1557557 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1557577 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 1557577 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1557577 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1557577 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 1557579 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=6.5302734375, floorSegmentMB=1.8095703125, forceMergeDeletesPctAllowed=21.5490129620436, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1557582 WARN (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1557617 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1557617 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1557618 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1557618 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1557618 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=83.3642578125, floorSegmentMB=1.6376953125, forceMergeDeletesPctAllowed=18.930821958232443, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1557619 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@12250a62[collection1_shard2_replica_t41] main]
[junit4] 2> 1557620 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1557620 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1557621 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1557621 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576197179875262464
[junit4] 2> 1557622 INFO (searcherExecutor-3800-thread-1-processing-n:127.0.0.1:36165_vz%2Fls x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@12250a62[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1557627 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1557628 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1557628 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36165/vz/ls/collection1_shard2_replica_t41/
[junit4] 2> 1557628 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1557628 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:36165/vz/ls/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 1557628 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1557629 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 1557637 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36165/vz/ls/collection1_shard2_replica_t41/ shard2
[junit4] 2> 1557791 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1557792 INFO (qtp1965647124-12057) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1353
[junit4] 2> 1557795 INFO (qtp1620959804-12007) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:36165_vz%252Fls&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1369
[junit4] 2> 1557933 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-2-001 of type TLOG
[junit4] 2> 1557934 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1557935 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@41c12401{/vz/ls,null,AVAILABLE}
[junit4] 2> 1557936 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5bee6e48{HTTP/1.1,[http/1.1]}{127.0.0.1:54108}
[junit4] 2> 1557936 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server Started @1560966ms
[junit4] 2> 1557936 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/vz/ls, hostPort=45241, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-2-001/cores}
[junit4] 2> 1557936 ERROR (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1557939 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1557939 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1557939 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1557939 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T21:39:28.357Z
[junit4] 2> 1557942 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1557942 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-2-001/solr.xml
[junit4] 2> 1557947 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1557950 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49606/solr
[junit4] 2> 1557966 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1557969 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1557972 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45241_vz%2Fls
[junit4] 2> 1557974 INFO (zkCallback-1323-thread-1-processing-n:127.0.0.1:36165_vz%2Fls) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1557974 INFO (zkCallback-1311-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1557975 INFO (zkCallback-1318-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1557976 INFO (zkCallback-1329-thread-1-processing-n:127.0.0.1:45241_vz%2Fls) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1558042 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1558050 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1558050 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1558051 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-2-001/cores
[junit4] 2> 1558074 INFO (qtp1620959804-12009) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:45241_vz%252Fls&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1558078 INFO (OverseerThreadFactory-3786-thread-4-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:45241_vz%2Fls for creating new replica
[junit4] 2> 1558078 INFO (OverseerCollectionConfigSetProcessor-98512323431104516-127.0.0.1:59698_vz%2Fls-n_0000000000) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1558081 INFO (SocketProxy-Acceptor-45241) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=52942,localport=45241], receiveBufferSize:130880
[junit4] 2> 1558083 INFO (SocketProxy-Acceptor-45241) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=54108,localport=33066], receiveBufferSize=139264
[junit4] 2> 1558084 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1558085 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1559121 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1559129 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 1559203 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1559228 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 1559228 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1559229 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1559229 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 1559231 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=6.5302734375, floorSegmentMB=1.8095703125, forceMergeDeletesPctAllowed=21.5490129620436, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1559234 WARN (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1559295 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1559295 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1559296 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1559296 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1559296 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=83.3642578125, floorSegmentMB=1.6376953125, forceMergeDeletesPctAllowed=18.930821958232443, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1559296 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@6a45381e[collection1_shard1_replica_t43] main]
[junit4] 2> 1559299 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1559299 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1559299 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1559300 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576197181635821568
[junit4] 2> 1559300 INFO (searcherExecutor-3811-thread-1-processing-n:127.0.0.1:45241_vz%2Fls x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@6a45381e[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1559306 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1559306 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1559306 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45241/vz/ls/collection1_shard1_replica_t43/
[junit4] 2> 1559306 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1559306 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:45241/vz/ls/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 1559307 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1559307 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 1559311 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45241/vz/ls/collection1_shard1_replica_t43/ shard1
[junit4] 2> 1559462 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1559464 INFO (qtp1501671281-12092) [n:127.0.0.1:45241_vz%2Fls c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1380
[junit4] 2> 1559467 INFO (qtp1620959804-12009) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:45241_vz%252Fls&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1393
[junit4] 2> 1559592 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-3-001 of type TLOG
[junit4] 2> 1559593 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1559594 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f967{/vz/ls,null,AVAILABLE}
[junit4] 2> 1559594 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@25345bca{HTTP/1.1,[http/1.1]}{127.0.0.1:46166}
[junit4] 2> 1559594 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.Server Started @1562625ms
[junit4] 2> 1559594 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/vz/ls, hostPort=64517, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-3-001/cores}
[junit4] 2> 1559595 ERROR (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1559596 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1559596 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1559596 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1559596 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T21:39:30.014Z
[junit4] 2> 1559599 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1559599 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-3-001/solr.xml
[junit4] 2> 1559602 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1559604 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49606/solr
[junit4] 2> 1559619 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1559624 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1559627 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64517_vz%2Fls
[junit4] 2> 1559629 INFO (zkCallback-1329-thread-1-processing-n:127.0.0.1:45241_vz%2Fls) [n:127.0.0.1:45241_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1559629 INFO (zkCallback-1318-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1559630 INFO (zkCallback-1323-thread-1-processing-n:127.0.0.1:36165_vz%2Fls) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1559631 INFO (zkCallback-1311-thread-1-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1559632 INFO (zkCallback-1335-thread-1-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1559758 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1559765 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1559765 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1559766 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-3-001/cores
[junit4] 2> 1559795 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:64517_vz%252Fls&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1559798 INFO (OverseerCollectionConfigSetProcessor-98512323431104516-127.0.0.1:59698_vz%2Fls-n_0000000000) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1559798 INFO (OverseerThreadFactory-3786-thread-5-processing-n:127.0.0.1:59698_vz%2Fls) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:64517_vz%2Fls for creating new replica
[junit4] 2> 1559801 INFO (SocketProxy-Acceptor-64517) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=46220,localport=64517], receiveBufferSize:130880
[junit4] 2> 1559801 INFO (SocketProxy-Acceptor-64517) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=46166,localport=42408], receiveBufferSize=139264
[junit4] 2> 1559804 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1559804 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1560821 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1560847 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 1560911 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1560940 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 1560941 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56525195
[junit4] 2> 1560941 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1560941 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 1560943 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=6.5302734375, floorSegmentMB=1.8095703125, forceMergeDeletesPctAllowed=21.5490129620436, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1560945 WARN (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1560989 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1560989 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1560990 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1560990 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1560990 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=83.3642578125, floorSegmentMB=1.6376953125, forceMergeDeletesPctAllowed=18.930821958232443, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1560991 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@2c76ac6b[collection1_shard2_replica_t45] main]
[junit4] 2> 1560992 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1560993 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1560994 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1560994 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576197183412109312
[junit4] 2> 1560994 INFO (searcherExecutor-3822-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@2c76ac6b[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1560998 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
[junit4] 2> 1560999 INFO (qtp51165563-12122) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1194
[junit4] 2> 1560999 INFO (updateExecutor-1332-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1560999 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1561000 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1561000 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
[junit4] 2> 1561000 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
[junit4] 2> 1561000 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1561000 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:36165/vz/ls/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:64517/vz/ls/collection1_shard2_replica_t45/]
[junit4] 2> 1561002 INFO (qtp1620959804-12013) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:64517_vz%252Fls&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1207
[junit4] 2> 1561006 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 1561006 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt
[junit4] 2> 1561006 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
[junit4] 2> 1561007 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:36165/vz/ls]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:64517_vz%252Fls&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1561024 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=57759,localport=36165], receiveBufferSize:130880
[junit4] 2> 1561025 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=59590,localport=36300], receiveBufferSize=139264
[junit4] 2> 1561037 INFO (qtp1965647124-12058) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 1561037 INFO (qtp1965647124-12058) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:64517_vz%2Fls, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:64517/vz/ls","node_name":"127.0.0.1:64517_vz%2Fls","state":"down","type":"TLOG"}
[junit4] 2> 1561804 INFO (OverseerCollectionConfigSetProcessor-98512323431104516-127.0.0.1:59698_vz%2Fls-n_0000000000) [n:127.0.0.1:59698_vz%2Fls ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1562043 INFO (qtp1965647124-12058) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:64517_vz%2Fls, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:64517/vz/ls","node_name":"127.0.0.1:64517_vz%2Fls","state":"recovering","type":"TLOG"}
[junit4] 2> 1562043 INFO (qtp1965647124-12058) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 1562043 INFO (qtp1965647124-12058) [n:127.0.0.1:36165_vz%2Fls ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:64517_vz%252Fls&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1007
[junit4] 2> 1562546 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 1562546 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:36165/vz/ls/collection1_shard2_replica_t41/].
[junit4] 2> 1562549 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42629,localport=36165], receiveBufferSize:130880
[junit4] 2> 1562549 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=59590,localport=33547], receiveBufferSize=139264
[junit4] 2> 1562551 INFO (qtp1965647124-12061) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576197185044742144,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1562552 INFO (qtp1965647124-12061) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 1562552 INFO (qtp1965647124-12061) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1562552 INFO (qtp1965647124-12061) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_t41] webapp=/vz/ls path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}{commit=} 0 1
[junit4] 2> 1562561 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=54639,localport=36165], receiveBufferSize:130880
[junit4] 2> 1562562 INFO (SocketProxy-Acceptor-36165) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=59590,localport=44512], receiveBufferSize=139264
[junit4] 2> 1562563 INFO (qtp1965647124-12060) [n:127.0.0.1:36165_vz%2Fls c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.c.S.Request [collection1_shard2_replica_t41] webapp=/vz/ls path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1562563 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 1562563 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 1562563 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 1562563 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 1562563 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Replication Recovery was successful.
[junit4] 2> 1562563 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
[junit4] 2> 1562564 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 starting background replication from leader
[junit4] 2> 1562564 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1562564 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1562565 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Updating version bucket highest from index after successful recovery.
[junit4] 2> 1562565 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576197185059422208
[junit4] 2> 1562566 INFO (recoveryExecutor-1333-thread-1-processing-n:127.0.0.1:64517_vz%2Fls x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true]
[junit4] 2> 1563007 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
[junit4] 2> 1563008 INFO (qtp1620959804-12012) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576197185523941376,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1563009 INFO (qtp1620959804-12012) [n:127.0.0.1:59698_vz%2Fls c:control_collection s:shard1 r:core_node2 x
[...truncated too long message...]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1583701 WARN (zkCallback-1335-thread-1-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1584453 WARN (zkCallback-1335-thread-2-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.SyncStrategy Closed, skipping sync up.
[junit4] 2> 1584453 INFO (zkCallback-1335-thread-2-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1584453 INFO (zkCallback-1335-thread-2-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] CLOSING SolrCore org.apache.solr.core.SolrCore@3341bbf0
[junit4] 2> 1584453 INFO (zkCallback-1335-thread-2-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard2.replica_t45, tag=859945968
[junit4] 2> 1584453 INFO (zkCallback-1335-thread-2-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e1e66ab: rootName = null, domain = solr.core.collection1.shard2.replica_t45, service url = null, agent id = null] for registry solr.core.collection1.shard2.replica_t45 / com.codahale.metrics.MetricRegistry@77d65e5
[junit4] 2> 1584473 INFO (zkCallback-1335-thread-2-processing-n:127.0.0.1:64517_vz%2Fls) [n:127.0.0.1:64517_vz%2Fls c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader, tag=859945968
[junit4] 2> 1584488 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@25345bca{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1584489 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5f967{/vz/ls,null,UNAVAILABLE}
[junit4] 2> 1584491 ERROR (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1584495 INFO (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49606 49606
[junit4] 2> 1591071 INFO (Thread-3390) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49606 49606
[junit4] 2> 1591072 WARN (Thread-3390) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2> 3 /solr/collections/collection1/state.json
[junit4] 2> 3 /solr/collections/collMinRf_1x3/state.json
[junit4] 2> 2 /solr/collections/c8n_crud_1x2/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1591072 WARN (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:59698/vz/ls, target: http://127.0.0.1:50499/vz/ls
[junit4] 2> 1591072 WARN (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SocketProxy Closing 9 connections to: http://127.0.0.1:64517/vz/ls, target: http://127.0.0.1:46166/vz/ls
[junit4] 2> 1591072 WARN (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:45241/vz/ls, target: http://127.0.0.1:54108/vz/ls
[junit4] 2> 1591072 WARN (TEST-HttpPartitionTest.test-seed#[2698F936505C811F]) [ ] o.a.s.c.SocketProxy Closing 9 connections to: http://127.0.0.1:36165/vz/ls, target: http://127.0.0.1:59590/vz/ls
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=2698F936505C811F -Dtests.slow=true -Dtests.locale=ar-LY -Dtests.timezone=Africa/Johannesburg -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 38.2s J0 | HttpPartitionTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:36165/vz/ls/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
[junit4] > at __randomizedtesting.SeedInfo.seed([2698F936505C811F:AECCC6ECFEA0ECE7]:0)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2698F936505C811F-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), id=FST50, text=BlockTreeOrds(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Lucene70), range_facet_i_dv=DocValuesFormat(name=Direct), intDvoDefault=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1385, maxMBSortInHeap=7.4806706081105165, sim=RandomSimilarity(queryNorm=false): {}, locale=ar-LY, timezone=Africa/Johannesburg
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_141 (64-bit)/cpus=3,threads=1,free=104961088,total=353685504
[junit4] 2> NOTE: All tests run in this JVM: [TestConfigSets, TestSha256AuthenticationProvider, SolrCloudExampleTest, ConnectionReuseTest, TestSchemaNameResource, HdfsChaosMonkeyNothingIsSafeTest, TriLevelCompositeIdRoutingTest, TestSchemalessBufferedUpdates, TestInitParams, TestPseudoReturnFields, TestFreeTextSuggestions, TestQuerySenderNoQuery, TestInPlaceUpdatesStandalone, StatsReloadRaceTest, TestPhraseSuggestions, TestSolrCoreProperties, AnalyticsQueryTest, DirectUpdateHandlerTest, CurrencyFieldTypeTest, TestDistributedSearch, MultiTermTest, MoveReplicaTest, OverriddenZkACLAndCredentialsProvidersTest, RequestHandlersTest, TestSolrDeletionPolicy2, DateFieldTest, TestCloudSchemaless, TestBlendedInfixSuggestions, SharedFSAutoReplicaFailoverTest, ZkCLITest, ConfigureRecoveryStrategyTest, XmlUpdateRequestHandlerTest, ClassificationUpdateProcessorFactoryTest, OverseerModifyCollectionTest, TestSolrQueryResponse, VersionInfoTest, SolrShardReporterTest, MetricsHandlerTest, DirectoryFactoryTest, V2ApiIntegrationTest, SuggesterTest, TestBulkSchemaConcurrent, PrimUtilsTest, TestConfigSetImmutable, TestDocBasedVersionConstraints, TestStandardQParsers, TestNamedUpdateProcessors, TestFieldCollectionResource, CSVRequestHandlerTest, TestExactStatsCache, TestSmileRequest, TestFaceting, TestPointFields, DocValuesMissingTest, RulesTest, TestTlogReplica, TestLeaderElectionWithEmptyReplica, TestRTimerTree, TestSolrCoreParser, TestSolrCloudWithDelegationTokens, TestClassicSimilarityFactory, TestNonDefinedSimilarityFactory, PeerSyncTest, NotRequiredUniqueKeyTest, TestSubQueryTransformerDistrib, TestQuerySenderListener, TestFilteredDocIdSet, BasicDistributedZkTest, TestPKIAuthenticationPlugin, TestNestedDocsSort, FieldAnalysisRequestHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestStressInPlaceUpdates, OverseerStatusTest, QueryElevationComponentTest, TestConfigSetsAPIExclusivity, AliasIntegrationTest, ReturnFieldsTest, TestBulkSchemaAPI, TestManagedSynonymGraphFilterFactory, TestSubQueryTransformer, DistributedFacetPivotWhiteBoxTest, TestOnReconnectListenerSupport, TestLegacyTerms, SecurityConfHandlerTest, ResponseHeaderTest, TestCoreAdminApis, TestComplexPhraseLeadingWildcard, TestHdfsUpdateLog, DeleteReplicaTest, NodeMutatorTest, TestTestInjection, HdfsBasicDistributedZk2Test, TestDistribDocBasedVersion, TestRequestForwarding, UninvertDocValuesMergePolicyTest, HttpPartitionTest]
[junit4] Completed [287/729 (1!)] on J0 in 38.22s, 1 test, 1 failure <<< FAILURES!
[...truncated 44846 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 121 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/121/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:41873/w_wm/ro/c8n_1x2
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:41873/w_wm/ro/c8n_1x2
at __randomizedtesting.SeedInfo.seed([89D85BA7978F6590:18C647D39730868]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:638)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.HttpPartitionTest.realTimeGetDocId(HttpPartitionTest.java:616)
at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:601)
at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:556)
at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:379)
at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:132)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
... 49 more
Build Log:
[...truncated 12561 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> 2527683 INFO (SUITE-HttpPartitionTest-seed#[89D85BA7978F6590]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/init-core-data-001
[junit4] 2> 2527685 WARN (SUITE-HttpPartitionTest-seed#[89D85BA7978F6590]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=105 numCloses=105
[junit4] 2> 2527685 INFO (SUITE-HttpPartitionTest-seed#[89D85BA7978F6590]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2527687 INFO (SUITE-HttpPartitionTest-seed#[89D85BA7978F6590]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 2527687 INFO (SUITE-HttpPartitionTest-seed#[89D85BA7978F6590]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /w_wm/ro
[junit4] 2> 2527704 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2527704 INFO (Thread-6470) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2527704 INFO (Thread-6470) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2527708 ERROR (Thread-6470) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2527804 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.ZkTestServer start zk server on port:51131
[junit4] 2> 2527881 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2527886 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2527890 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2527893 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2527897 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2527904 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2527906 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2527910 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2527913 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2527915 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2527916 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2527919 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 2528084 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2528085 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ea9878b{/w_wm/ro,null,AVAILABLE}
[junit4] 2> 2528085 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1e36d982{HTTP/1.1,[http/1.1]}{127.0.0.1:35024}
[junit4] 2> 2528085 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server Started @2530685ms
[junit4] 2> 2528085 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/tempDir-001/control/data, replicaType=NRT, hostContext=/w_wm/ro, hostPort=64159, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/control-001/cores}
[junit4] 2> 2528086 ERROR (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2528088 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 2528088 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2528088 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2528089 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T12:09:31.647Z
[junit4] 2> 2528100 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2528100 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/control-001/solr.xml
[junit4] 2> 2528105 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2528108 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51131/solr
[junit4] 2> 2528790 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2528790 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:64159_w_wm%2Fro
[junit4] 2> 2528796 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.Overseer Overseer (id=98510082622488580-127.0.0.1:64159_w_wm%2Fro-n_0000000000) starting
[junit4] 2> 2528831 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64159_w_wm%2Fro
[junit4] 2> 2528839 INFO (OverseerStateUpdate-98510082622488580-127.0.0.1:64159_w_wm%2Fro-n_0000000000) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2528992 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2529003 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2529003 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2529005 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/control-001/cores
[junit4] 2> 2529065 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2529067 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51131/solr ready
[junit4] 2> 2529068 INFO (SocketProxy-Acceptor-64159) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38142,localport=64159], receiveBufferSize:130880
[junit4] 2> 2529069 INFO (SocketProxy-Acceptor-64159) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35024,localport=62230], receiveBufferSize=139264
[junit4] 2> 2529070 INFO (qtp816037604-22278) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:64159_w_wm%252Fro&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2529073 INFO (OverseerThreadFactory-9219-thread-1-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 2529229 INFO (SocketProxy-Acceptor-64159) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=54879,localport=64159], receiveBufferSize:130880
[junit4] 2> 2529231 INFO (SocketProxy-Acceptor-64159) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35024,localport=44105], receiveBufferSize=139264
[junit4] 2> 2529231 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2529232 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2529339 INFO (zkCallback-3102-thread-1-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2530250 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2530261 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 2530336 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2530357 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 2530357 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2530357 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2530357 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 2530359 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=50.6220703125, floorSegmentMB=0.54296875, forceMergeDeletesPctAllowed=26.189507454832803, segmentsPerTier=27.0, maxCFSSegmentSizeMB=0.4853515625, noCFSRatio=0.1243947657756233
[junit4] 2> 2530361 WARN (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2530396 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2530396 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2530396 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2530396 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2530397 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=53.8134765625, floorSegmentMB=0.7138671875, forceMergeDeletesPctAllowed=24.03436026844639, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8419205616559103
[junit4] 2> 2530397 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ac3724d[control_collection_shard1_replica_n1] main]
[junit4] 2> 2530399 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2530400 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2530400 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2530401 INFO (searcherExecutor-9222-thread-1-processing-n:127.0.0.1:64159_w_wm%2Fro x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@1ac3724d[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2530401 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576161324783632384
[junit4] 2> 2530409 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2530409 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2530409 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64159/w_wm/ro/control_collection_shard1_replica_n1/
[junit4] 2> 2530410 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2530410 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:64159/w_wm/ro/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 2530410 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2530415 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64159/w_wm/ro/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 2530520 INFO (zkCallback-3102-thread-1-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2530569 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2530570 INFO (qtp816037604-22279) [n:127.0.0.1:64159_w_wm%2Fro c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1339
[junit4] 2> 2530577 INFO (qtp816037604-22278) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2530678 INFO (zkCallback-3102-thread-1-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2531079 INFO (OverseerCollectionConfigSetProcessor-98510082622488580-127.0.0.1:64159_w_wm%2Fro-n_0000000000) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2531579 INFO (qtp816037604-22278) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:64159_w_wm%252Fro&wt=javabin&version=2} status=0 QTime=2509
[junit4] 2> 2531586 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2531588 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51131/solr ready
[junit4] 2> 2531588 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2531589 INFO (SocketProxy-Acceptor-64159) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=55983,localport=64159], receiveBufferSize:130880
[junit4] 2> 2531589 INFO (SocketProxy-Acceptor-64159) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35024,localport=35070], receiveBufferSize=139264
[junit4] 2> 2531590 INFO (qtp816037604-22284) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2531593 INFO (OverseerThreadFactory-9219-thread-2-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 2531594 WARN (OverseerThreadFactory-9219-thread-2-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 2531801 INFO (qtp816037604-22284) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2531801 INFO (qtp816037604-22284) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=211
[junit4] 2> 2531978 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-1-001 of type NRT
[junit4] 2> 2531978 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2531980 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d9b23f0{/w_wm/ro,null,AVAILABLE}
[junit4] 2> 2531980 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5ee1144f{HTTP/1.1,[http/1.1]}{127.0.0.1:40647}
[junit4] 2> 2531980 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server Started @2534582ms
[junit4] 2> 2531981 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/w_wm/ro, hostPort=60921, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-1-001/cores}
[junit4] 2> 2531981 ERROR (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2531981 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 2531981 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2531981 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2531981 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T12:09:35.539Z
[junit4] 2> 2532009 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2532009 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-1-001/solr.xml
[junit4] 2> 2532012 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2532015 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51131/solr
[junit4] 2> 2532068 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2532077 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2532090 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60921_w_wm%2Fro
[junit4] 2> 2532092 INFO (zkCallback-3102-thread-1-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2532092 INFO (zkCallback-3109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2532097 INFO (zkCallback-3114-thread-1-processing-n:127.0.0.1:60921_w_wm%2Fro) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2532187 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2532215 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2532216 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2532217 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-1-001/cores
[junit4] 2> 2532250 INFO (qtp816037604-22285) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:60921_w_wm%252Fro&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2532261 INFO (OverseerThreadFactory-9219-thread-3-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:60921_w_wm%2Fro for creating new replica
[junit4] 2> 2532261 INFO (OverseerCollectionConfigSetProcessor-98510082622488580-127.0.0.1:64159_w_wm%2Fro-n_0000000000) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2532264 INFO (SocketProxy-Acceptor-60921) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40949,localport=60921], receiveBufferSize:130880
[junit4] 2> 2532265 INFO (SocketProxy-Acceptor-60921) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40647,localport=38288], receiveBufferSize=139264
[junit4] 2> 2532273 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2532273 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2533307 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2533318 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 2533482 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2533554 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 2533554 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2533554 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2533554 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 2533566 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=50.6220703125, floorSegmentMB=0.54296875, forceMergeDeletesPctAllowed=26.189507454832803, segmentsPerTier=27.0, maxCFSSegmentSizeMB=0.4853515625, noCFSRatio=0.1243947657756233
[junit4] 2> 2533577 WARN (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2533628 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2533628 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2533630 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2533630 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2533631 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=53.8134765625, floorSegmentMB=0.7138671875, forceMergeDeletesPctAllowed=24.03436026844639, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8419205616559103
[junit4] 2> 2533631 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@18eaa1f8[collection1_shard2_replica_n41] main]
[junit4] 2> 2533643 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2533644 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2533645 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2533645 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576161328185212928
[junit4] 2> 2533647 INFO (searcherExecutor-9233-thread-1-processing-n:127.0.0.1:60921_w_wm%2Fro x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@18eaa1f8[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2533718 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2533718 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2533718 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60921/w_wm/ro/collection1_shard2_replica_n41/
[junit4] 2> 2533718 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2533718 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:60921/w_wm/ro/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 2533718 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2533834 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60921/w_wm/ro/collection1_shard2_replica_n41/ shard2
[junit4] 2> 2533953 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2533970 INFO (qtp817208059-22328) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1697
[junit4] 2> 2533986 INFO (qtp816037604-22285) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:60921_w_wm%252Fro&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1740
[junit4] 2> 2534264 INFO (OverseerCollectionConfigSetProcessor-98510082622488580-127.0.0.1:64159_w_wm%2Fro-n_0000000000) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2534279 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-2-001 of type NRT
[junit4] 2> 2534279 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2534288 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2ab6c103{/w_wm/ro,null,AVAILABLE}
[junit4] 2> 2534289 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@62900a0e{HTTP/1.1,[http/1.1]}{127.0.0.1:46976}
[junit4] 2> 2534289 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server Started @2536891ms
[junit4] 2> 2534289 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/w_wm/ro, hostPort=55207, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-2-001/cores}
[junit4] 2> 2534289 ERROR (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2534289 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 2534289 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2534290 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2534290 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T12:09:37.848Z
[junit4] 2> 2534318 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2534318 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-2-001/solr.xml
[junit4] 2> 2534323 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2534326 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51131/solr
[junit4] 2> 2534354 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2534360 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2534374 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55207_w_wm%2Fro
[junit4] 2> 2534377 INFO (zkCallback-3114-thread-1-processing-n:127.0.0.1:60921_w_wm%2Fro) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2534377 INFO (zkCallback-3109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2534378 INFO (zkCallback-3102-thread-2-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2534389 INFO (zkCallback-3120-thread-1-processing-n:127.0.0.1:55207_w_wm%2Fro) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2534681 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2534694 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2534695 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2534696 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-2-001/cores
[junit4] 2> 2534794 INFO (qtp816037604-22281) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:55207_w_wm%252Fro&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2534808 INFO (OverseerThreadFactory-9219-thread-4-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:55207_w_wm%2Fro for creating new replica
[junit4] 2> 2534812 INFO (SocketProxy-Acceptor-55207) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42215,localport=55207], receiveBufferSize:130880
[junit4] 2> 2534813 INFO (SocketProxy-Acceptor-55207) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=46976,localport=33502], receiveBufferSize=139264
[junit4] 2> 2534814 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2534814 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2535833 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2535847 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 2535993 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2536026 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 2536027 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2536027 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2536027 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 2536030 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=50.6220703125, floorSegmentMB=0.54296875, forceMergeDeletesPctAllowed=26.189507454832803, segmentsPerTier=27.0, maxCFSSegmentSizeMB=0.4853515625, noCFSRatio=0.1243947657756233
[junit4] 2> 2536033 WARN (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2536088 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2536088 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2536090 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2536090 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2536091 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=53.8134765625, floorSegmentMB=0.7138671875, forceMergeDeletesPctAllowed=24.03436026844639, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8419205616559103
[junit4] 2> 2536091 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@334f15af[collection1_shard1_replica_n43] main]
[junit4] 2> 2536100 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2536100 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2536101 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2536101 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576161330760515584
[junit4] 2> 2536102 INFO (searcherExecutor-9244-thread-1-processing-n:127.0.0.1:55207_w_wm%2Fro x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@334f15af[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2536111 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2536111 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2536111 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55207/w_wm/ro/collection1_shard1_replica_n43/
[junit4] 2> 2536112 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2536112 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:55207/w_wm/ro/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 2536112 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2536127 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55207/w_wm/ro/collection1_shard1_replica_n43/ shard1
[junit4] 2> 2536278 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2536280 INFO (qtp1119368887-22361) [n:127.0.0.1:55207_w_wm%2Fro c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1467
[junit4] 2> 2536285 INFO (qtp816037604-22281) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:55207_w_wm%252Fro&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1491
[junit4] 2> 2536442 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-3-001 of type NRT
[junit4] 2> 2536443 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2536444 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1dc4221e{/w_wm/ro,null,AVAILABLE}
[junit4] 2> 2536445 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@33dc6a57{HTTP/1.1,[http/1.1]}{127.0.0.1:43223}
[junit4] 2> 2536445 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.e.j.s.Server Started @2539048ms
[junit4] 2> 2536445 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/w_wm/ro, hostPort=41873, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-3-001/cores}
[junit4] 2> 2536445 ERROR (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2536445 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 2536445 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2536445 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2536445 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-19T12:09:40.003Z
[junit4] 2> 2536456 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2536456 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-3-001/solr.xml
[junit4] 2> 2536461 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2536464 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51131/solr
[junit4] 2> 2536506 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2536511 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2536515 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41873_w_wm%2Fro
[junit4] 2> 2536517 INFO (zkCallback-3102-thread-1-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2536517 INFO (zkCallback-3109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2536518 INFO (zkCallback-3114-thread-1-processing-n:127.0.0.1:60921_w_wm%2Fro) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2536518 INFO (zkCallback-3120-thread-1-processing-n:127.0.0.1:55207_w_wm%2Fro) [n:127.0.0.1:55207_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2536554 INFO (zkCallback-3126-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2536638 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2536652 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2536653 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2536654 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-3-001/cores
[junit4] 2> 2536732 INFO (SocketProxy-Acceptor-41873) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42767,localport=41873], receiveBufferSize:130880
[junit4] 2> 2536733 INFO (SocketProxy-Acceptor-41873) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43223,localport=58109], receiveBufferSize=139264
[junit4] 2> 2536735 INFO (qtp809546689-22395) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41873_w_wm%252Fro&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2536763 INFO (OverseerThreadFactory-9219-thread-5-processing-n:127.0.0.1:64159_w_wm%2Fro) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:41873_w_wm%2Fro for creating new replica
[junit4] 2> 2536764 INFO (OverseerCollectionConfigSetProcessor-98510082622488580-127.0.0.1:64159_w_wm%2Fro-n_0000000000) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2536767 INFO (SocketProxy-Acceptor-41873) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=36470,localport=41873], receiveBufferSize:130880
[junit4] 2> 2536771 INFO (SocketProxy-Acceptor-41873) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43223,localport=62371], receiveBufferSize=139264
[junit4] 2> 2536771 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2536772 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2537789 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2537799 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
[junit4] 2> 2537888 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2537911 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
[junit4] 2> 2537912 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61cd23e8
[junit4] 2> 2537912 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2537912 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
[junit4] 2> 2537915 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=50.6220703125, floorSegmentMB=0.54296875, forceMergeDeletesPctAllowed=26.189507454832803, segmentsPerTier=27.0, maxCFSSegmentSizeMB=0.4853515625, noCFSRatio=0.1243947657756233
[junit4] 2> 2537918 WARN (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2537969 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2537969 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2537970 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2537970 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2537971 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=53.8134765625, floorSegmentMB=0.7138671875, forceMergeDeletesPctAllowed=24.03436026844639, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8419205616559103
[junit4] 2> 2537971 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@4d0daa19[collection1_shard2_replica_n45] main]
[junit4] 2> 2537972 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2537973 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2537974 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2537974 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576161332724498432
[junit4] 2> 2537975 INFO (searcherExecutor-9255-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [collection1_shard2_replica_n45] Registered new searcher Searcher@4d0daa19[collection1_shard2_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2537978 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n45
[junit4] 2> 2537979 INFO (qtp809546689-22398) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1208
[junit4] 2> 2537979 INFO (updateExecutor-3123-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 2537980 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 2537980 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 2537980 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n45]
[junit4] 2> 2537980 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2537980 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n45] as recovering, leader is [http://127.0.0.1:60921/w_wm/ro/collection1_shard2_replica_n41/] and I am [http://127.0.0.1:41873/w_wm/ro/collection1_shard2_replica_n45/]
[junit4] 2> 2537982 INFO (qtp809546689-22395) [n:127.0.0.1:41873_w_wm%2Fro ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:41873_w_wm%252Fro&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1247
[junit4] 2> 2537984 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 2537984 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt
[junit4] 2> 2537984 INFO (TEST-HttpPartitionTest.test-seed#[89D85BA7978F6590]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
[junit4] 2> 2537984 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:60921/w_wm/ro]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:41873_w_wm%252Fro&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 2537985 INFO (SocketProxy-Acceptor-60921) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=41198,localport=60921], receiveBufferSize:130880
[junit4] 2> 2537985 INFO (SocketProxy-Acceptor-60921) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40647,localport=47232], receiveBufferSize=139264
[junit4] 2> 2537986 INFO (qtp817208059-22330) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 2537987 INFO (qtp817208059-22330) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:41873_w_wm%2Fro, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:41873/w_wm/ro","node_name":"127.0.0.1:41873_w_wm%2Fro","state":"down","type":"NRT"}
[junit4] 2> 2538767 INFO (OverseerCollectionConfigSetProcessor-98510082622488580-127.0.0.1:64159_w_wm%2Fro-n_0000000000) [n:127.0.0.1:64159_w_wm%2Fro ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2538987 INFO (qtp817208059-22330) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:41873_w_wm%2Fro, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:41873/w_wm/ro","node_name":"127.0.0.1:41873_w_wm%2Fro","state":"recovering","type":"NRT"}
[junit4] 2> 2538988 INFO (qtp817208059-22330) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 2538988 INFO (qtp817208059-22330) [n:127.0.0.1:60921_w_wm%2Fro ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:41873_w_wm%252Fro&onlyIfLeaderActive=true&core=collection1_shard2_replica_n41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001
[junit4] 2> 2539494 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:60921/w_wm/ro/collection1_shard2_replica_n41/] - recoveringAfterStartup=[true]
[junit4] 2> 2539495 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_n45 url=http://127.0.0.1:41873/w_wm/ro START replicas=[http://127.0.0.1:60921/w_wm/ro/collection1_shard2_replica_n41/] nUpdates=100
[junit4] 2> 2539495 INFO (SocketProxy-Acceptor-60921) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49619,localport=60921], receiveBufferSize:130880
[junit4] 2> 2539496 INFO (SocketProxy-Acceptor-60921) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40647,localport=61599], receiveBufferSize=139264
[junit4] 2> 2539496 INFO (qtp817208059-22326) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 2539496 INFO (qtp817208059-22326) [n:127.0.0.1:60921_w_wm%2Fro c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp=/w_wm/ro path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful.
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync.
[junit4] 2> 2539497 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy No replay needed.
[junit4] 2> 2539498 INFO (recoveryExecutor-3124-thread-1-processing-n:127.0.0.1:41873_w_wm%2Fro x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41873_w_wm%2Fro c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
[junit4] 2> 2539991 INF
[...truncated too long message...]
onTest.realTimeGetDocId(HttpPartitionTest.java:616)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:601)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:556)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:379)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:132)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:171)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
[junit4] > at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
[junit4] > at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
[junit4] > at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
[junit4] > at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
[junit4] > at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
[junit4] > ... 49 more
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_89D85BA7978F6590-001
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=sl-SI, timezone=Atlantic/Cape_Verde
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_141 (64-bit)/cpus=3,threads=1,free=298864160,total=512163840
[junit4] 2> NOTE: All tests run in this JVM: [TestBlendedInfixSuggestions, TestQuerySenderListener, SuggesterTest, TestOnReconnectListenerSupport, CdcrReplicationDistributedZkTest, ReturnFieldsTest, TestUnifiedSolrHighlighter, DateMathParserTest, TestTrieFacet, TestAuthenticationFramework, SolrJmxReporterCloudTest, SolrInfoBeanTest, SpatialFilterTest, TestDistribIDF, RegexBoostProcessorTest, TestSmileRequest, TestGeoJSONResponseWriter, TestRequestForwarding, NoCacheHeaderTest, TestCloudSchemaless, TestCloudRecovery, TestTolerantUpdateProcessorRandomCloud, TestIBSimilarityFactory, ResourceLoaderTest, HdfsUnloadDistributedZkTest, TestXIncludeConfig, BigEndianAscendingWordSerializerTest, TestSha256AuthenticationProvider, SaslZkACLProviderTest, ClassificationUpdateProcessorTest, RulesTest, TestScoreJoinQPScore, TestSchemalessBufferedUpdates, HardAutoCommitTest, BlockJoinFacetRandomTest, TestCoreAdminApis, PeerSyncReplicationTest, TestPointFields, TestSolrDeletionPolicy2, MultiTermTest, CoreMergeIndexesAdminHandlerTest, TestStandardQParsers, CdcrUpdateLogTest, HdfsDirectoryFactoryTest, LeaderFailoverAfterPartitionTest, ZkCLITest, CustomCollectionTest, HdfsRecoverLeaseTest, ResponseLogComponentTest, TestFilteredDocIdSet, StatsReloadRaceTest, TestBulkSchemaConcurrent, TestStressReorder, SecurityConfHandlerTest, CollectionsAPIAsyncDistributedZkTest, CdcrRequestHandlerTest, TestCloudPivotFacet, AssignTest, CollectionStateFormat2Test, TestCollectionAPIs, TestMaxTokenLenTokenizer, LargeFieldTest, DeleteLastCustomShardedReplicaTest, TestOmitPositions, TestBulkSchemaAPI, RemoteQueryErrorTest, AliasIntegrationTest, TestClassicSimilarityFactory, TestDynamicFieldCollectionResource, TestSerializedLuceneMatchVersion, TestRTimerTree, TestExactStatsCache, HdfsBasicDistributedZk2Test, DocExpirationUpdateProcessorFactoryTest, TestInitParams, DistributedSpellCheckComponentTest, TestBinaryField, BufferStoreTest, PrimitiveFieldTypeTest, DirectSolrConnectionTest, TestFieldCacheSort, CSVRequestHandlerTest, TestTlogReplica, UUIDUpdateProcessorFallbackTest, CoreAdminHandlerTest, SliceStateTest, TestManagedSchemaAPI, MoveReplicaHDFSTest, DefaultValueUpdateProcessorTest, IndexBasedSpellCheckerTest, NotRequiredUniqueKeyTest, JavabinLoaderTest, TestUseDocValuesAsStored2, TestGroupingSearch, CurrencyFieldTypeTest, TestAddFieldRealTimeGet, TestCustomDocTransformer, BJQParserTest, TestManagedSynonymGraphFilterFactory, TestHighlightDedupGrouping, TestFoldingMultitermQuery, UUIDFieldTest, TestExtendedDismaxParser, TestCustomSort, TestPHPSerializedResponseWriter, TestRebalanceLeaders, TestLeaderInitiatedRecoveryThread, TestConfigSets, AddBlockUpdateTest, PrimUtilsTest, FieldAnalysisRequestHandlerTest, SolrShardReporterTest, UninvertDocValuesMergePolicyTest, IndexSchemaTest, ManagedSchemaRoundRobinCloudTest, SimpleCollectionCreateDeleteTest, DocValuesNotIndexedTest, AlternateDirectoryTest, TestShortCircuitedRequests, GraphQueryTest, OverriddenZkACLAndCredentialsProvidersTest, TestHalfAndHalfDocValues, DirectUpdateHandlerOptimizeTest, TestStressVersions, TestNestedDocsSort, TestXmlQParserPlugin, TestJmxIntegration, TestCollectionsAPIViaSolrCloudCluster, TestNoOpRegenerator, TestNumericTerms64, TestJsonFacets, TestLegacyFieldReuse, SearchHandlerTest, TestMacros, VersionInfoTest, TestNumericTokenStream, TestSolrCoreParser, ShardRoutingTest, TestCustomStream, TestAtomicUpdateErrorCases, TestCryptoKeys, TestFuzzyAnalyzedSuggestions, DistribDocExpirationUpdateProcessorTest, DeleteReplicaTest, TestSimpleTextCodec, TestWriterPerf, RecoveryZkTest, TestPseudoReturnFields, MinimalSchemaTest, TestDFRSimilarityFactory, CircularListTest, SolrMetricReporterTest, TestRecoveryHdfs, DirectoryFactoryTest, TestSchemaNameResource, TestExpandComponent, SolrCoreMetricManagerTest, TestPhraseSuggestions, ReplicationFactorTest, DocValuesTest, AnalyticsQueryTest, TestDistribDocBasedVersion, TestCursorMarkWithoutUniqueKey, CloudExitableDirectoryReaderTest, CoreAdminCreateDiscoverTest, SolrCloudExampleTest, TestSearcherReuse, ChaosMonkeyNothingIsSafeTest, TestFreeTextSuggestions, BasicAuthIntegrationTest, HighlighterConfigTest, HdfsCollectionsAPIDistributedZkTest, TestOrdValues, TestBackupRepositoryFactory, TestLegacyNumericRangeQueryBuilder, NodeMutatorTest, UnloadDistributedZkTest, SyncSliceTest, OverseerTest, TestReplicationHandler, TestDistributedSearch, TestRealTimeGet, DistributedTermsComponentTest, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, SpellCheckComponentTest, SolrCmdDistributorTest, PeerSyncTest, TestIndexSearcher, ShowFileRequestHandlerTest, SolrIndexSplitterTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, SuggesterFSTTest, SolrRequestParserTest, SuggesterWFSTTest, PolyFieldTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, XmlUpdateRequestHandlerTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, TestSolrQueryParser, LoggingHandlerTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, UpdateParamsTest, TestQuerySenderNoQuery, TestStressRecovery, TestMergePolicyConfig, OutputWriterTest, TestSolrCoreProperties, TestCharFilters, SynonymTokenizerTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestFastOutputStream, URLClassifyProcessorTest, PluginInfoTest, DateFieldTest, RAMDirectoryFactoryTest, TestLRUCache, ZkNodePropsTest, SystemInfoHandlerTest, TestRTGBase, CursorPagingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestDistributedMissingSort, TestSimpleTrackingShardHandler, AsyncCallRequestStatusResponseTest, CdcrReplicationHandlerTest, CdcrVersionReplicationTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CollectionReloadTest, CreateCollectionCleanupTest, DeleteStatusTest, DistributedVersionInfoTest, HttpPartitionTest]
[junit4] Completed [546/729 (1!)] on J0 in 660.57s, 1 test, 1 error <<< FAILURES!
[...truncated 43924 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 120 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/120/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
3 tests failed.
FAILED: org.apache.solr.update.AutoCommitTest.testCommitWithin
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([1130BB96224587D9:ABE2D4EEA16B69CC]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:886)
at org.apache.solr.update.AutoCommitTest.testCommitWithin(AutoCommitTest.java:353)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>
request was:q=id:529&qt=&start=0&rows=20&version=2.2
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:879)
... 40 more
FAILED: org.apache.solr.update.AutoCommitTest.testMaxDocs
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([1130BB96224587D9:A8B16D490EAF8353]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:886)
at org.apache.solr.update.AutoCommitTest.testMaxDocs(AutoCommitTest.java:225)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>
request was:q=id:14&qt=&start=0&rows=20&version=2.2
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:879)
... 40 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=26295, name=jetty-launcher-3602-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=26295, name=jetty-launcher-3602-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
at __randomizedtesting.SeedInfo.seed([1130BB96224587D9]:0)
Build Log:
[...truncated 11988 lines...]
[junit4] Suite: org.apache.solr.update.AutoCommitTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.update.AutoCommitTest_1130BB96224587D9-001/init-core-data-001
[junit4] 2> 2287288 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2287289 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2287289 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2287289 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 2287290 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 2287317 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2287334 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=test
[junit4] 2> 2287427 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2287478 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d512b0f
[junit4] 2> 2287486 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d512b0f
[junit4] 2> 2287486 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d512b0f
[junit4] 2> 2287488 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 2287522 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2287546 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2287640 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2287651 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 2287651 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d512b0f
[junit4] 2> 2287651 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2287651 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.update.AutoCommitTest_1130BB96224587D9-001/init-core-data-001/]
[junit4] 2> 2287653 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=54.322265625, floorSegmentMB=1.509765625, forceMergeDeletesPctAllowed=25.539733084702263, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2287709 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2287709 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2287709 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2287710 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2287710 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=60.14453125, floorSegmentMB=0.8466796875, forceMergeDeletesPctAllowed=21.261070715103944, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2287710 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@24b3acdb[collection1] main]
[junit4] 2> 2287711 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 2287715 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2287747 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2287748 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 2287748 INFO (coreLoadExecutor-7663-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576107789212712960
[junit4] 2> 2287752 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 2287752 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 2287753 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 2287753 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 2287753 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 2287753 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 2287753 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 2287754 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 2287754 INFO (searcherExecutor-7664-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@24b3acdb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2287754 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 2287757 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMaxTime
[junit4] 2> 2287757 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 2287758 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@302ff263[collection1] realtime]
[junit4] 2> 2287759 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 1
[junit4] 2> 2287759 ERROR (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 2287760 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 2287808 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2287835 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2287993 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2288005 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 2288060 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d512b0f
[junit4] 2> 2288061 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.update.AutoCommitTest_1130BB96224587D9-001/init-core-data-001/]
[junit4] 2> 2288150 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2288150 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2288151 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@57051d8b[collection1] main]
[junit4] 2> 2288152 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 2288153 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2288155 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2288156 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576107789640531968
[junit4] 2> 2288156 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 2288158 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=208482544, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2288158 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2288158 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 2288158 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 2288158 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 2288159 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 2288159 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 2288160 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 2288160 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 2288161 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 2288164 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@57051d8b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2288165 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2358ccf0[collection1] main]
[junit4] 2> 2288165 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1a8014f5
[junit4] 2> 2288165 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=444601589
[junit4] 2> 2288165 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5ca8d19a: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@60d59cf2
[junit4] 2> 2288168 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2358ccf0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2288196 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[529 (1576107789680377856)]} 0 5
[junit4] 2> 2288197 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:529&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2289697 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 2289698 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@24e9599d[collection1] main]
[junit4] 2> 2289698 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2289700 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@24e9599d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):c1)))}
[junit4] 2> 2289704 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[530 (1576107791263727616)]} 0 1513
[junit4] 2> 2289704 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:529&qt=&start=0&rows=20&version=2.2} hits=1 status=0 QTime=0
[junit4] 2> 2289705 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:530&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2289705 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=null path=null params={}{delete=[529 (-1576107791264776192)]} 0 0
[junit4] 2> 2289705 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:529&qt=&start=0&rows=20&version=2.2} hits=1 status=0 QTime=0
[junit4] 2> 2291204 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 2291205 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c5c129d[collection1] main]
[junit4] 2> 2291206 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2291207 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1c5c129d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.1.0):c1)))}
[junit4] 2> 2291212 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[550 (1576107792844980224)]} 0 3022
[junit4] 2> 2291212 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:529&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792844980225)]} 0 3022
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792846028800)]} 0 3022
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792846028801)]} 0 3022
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792846028802)]} 0 3023
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792846028803)]} 0 3023
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792846028804)]} 0 3023
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792846028805)]} 0 3023
[junit4] 2> 2291213 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792846028806)]} 0 3023
[junit4] 2> 2291214 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792847077376)]} 0 3023
[junit4] 2> 2291214 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1576107792847077377)]} 0 3023
[junit4] 2> 2291214 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:500&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2292712 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 2292714 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7f0f78ec[collection1] main]
[junit4] 2> 2292715 INFO (commitScheduler-7672-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2292717 INFO (searcherExecutor-7669-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7f0f78ec[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.1.0):c1) Uninverting(_2(7.1.0):c11/9:delGen=1)))}
[junit4] 2> 2292723 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[531 (1576107794429378560)]} 0 4534
[junit4] 2> 2292724 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:500&qt=&start=0&rows=20&version=2.2} hits=1 status=0 QTime=0
[junit4] 2> 2292724 INFO (TEST-AutoCommitTest.testMaxTime-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testMaxTime
[junit4] 2> 2292738 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testCommitWithin
[junit4] 2> 2292738 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 2292739 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2416b805[collection1] realtime]
[junit4] 2> 2292739 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
[junit4] 2> 2292739 ERROR (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 2292739 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 2292763 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2292777 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2292852 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2292863 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 2292902 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d512b0f
[junit4] 2> 2292902 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.update.AutoCommitTest_1130BB96224587D9-001/init-core-data-001/]
[junit4] 2> 2292952 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2292952 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2292953 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3fd7a2b6[collection1] main]
[junit4] 2> 2292954 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 2292954 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2292957 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2292958 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=45, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7351225263702491]
[junit4] 2> 2292958 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2292959 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 2292959 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 2292959 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 2292959 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 2292960 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 2292960 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 2292960 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 2292960 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 2292961 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 2292962 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3fd7a2b6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2292963 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3de8bb09[collection1] main]
[junit4] 2> 2292963 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1b299a1e
[junit4] 2> 2292963 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=455711262
[junit4] 2> 2292963 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4393b94a: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@60d59cf2
[junit4] 2> 2292971 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[529 (1576107794689425408)]} 0 0
[junit4] 2> 2292971 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:529&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2292973 INFO (searcherExecutor-7673-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3de8bb09[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2293223 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[530 (1576107794953666560)]} 0 252
[junit4] 2> 2293223 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:530&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2293224 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {delete=[529 (-1576107794954715136)]} 0 253
[junit4] 2> 2293224 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:529&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2293225 ERROR (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//result[@numFound=1]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:q=id:529&qt=&start=0&rows=20&version=2.2
[junit4] 2> 2293225 ERROR (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=id:529&qt=&start=0&rows=20&version=2.2:java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:q=id:529&qt=&start=0&rows=20&version=2.2
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:879)
[junit4] 2> at org.apache.solr.update.AutoCommitTest.testCommitWithin(AutoCommitTest.java:353)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 2293226 INFO (TEST-AutoCommitTest.testCommitWithin-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testCommitWithin
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=AutoCommitTest -Dtests.method=testCommitWithin -Dtests.seed=1130BB96224587D9 -Dtests.slow=true -Dtests.locale=de-DE -Dtests.timezone=America/Antigua -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.51s J1 | AutoCommitTest.testCommitWithin <<<
[junit4] > Throwable #1: java.lang.RuntimeException: Exception during query
[junit4] > at __randomizedtesting.SeedInfo.seed([1130BB96224587D9:ABE2D4EEA16B69CC]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:886)
[junit4] > at org.apache.solr.update.AutoCommitTest.testCommitWithin(AutoCommitTest.java:353)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
[junit4] > xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] > <response>
[junit4] > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] > </response>
[junit4] > request was:q=id:529&qt=&start=0&rows=20&version=2.2
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:879)
[junit4] > ... 40 more
[junit4] 2> 2293231 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testMaxDocs
[junit4] 2> 2293232 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 2293232 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@33be24f9[collection1] realtime]
[junit4] 2> 2293232 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
[junit4] 2> 2293232 ERROR (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/core.properties
[junit4] 2> 2293232 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 2293254 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2293302 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2293369 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2293376 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1
[junit4] 2> 2293398 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d512b0f
[junit4] 2> 2293398 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.update.AutoCommitTest_1130BB96224587D9-001/init-core-data-001/]
[junit4] 2> 2293446 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2293446 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2293447 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@38476fef[collection1] main]
[junit4] 2> 2293448 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 2293449 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2293452 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2293454 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 2293454 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2293454 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2293454 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 2293454 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 2293454 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 2293455 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 2293455 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 2293456 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 2293456 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 2293456 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 2293458 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@38476fef[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2293458 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e5c6e9a[collection1] main]
[junit4] 2> 2293459 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@22cb5cbd
[junit4] 2> 2293459 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=583752893
[junit4] 2> 2293459 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1c490ffa: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@60d59cf2
[junit4] 2> 2293472 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1e5c6e9a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2293473 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[0 (1576107795213713408)]} 0 2
[junit4] 2> 2293473 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[1 (1576107795215810560)]} 0 2
[junit4] 2> 2293473 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[2 (1576107795215810561)]} 0 2
[junit4] 2> 2293473 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[3 (1576107795215810562)]} 0 2
[junit4] 2> 2293474 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[4 (1576107795215810563)]} 0 3
[junit4] 2> 2293474 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[5 (1576107795216859136)]} 0 3
[junit4] 2> 2293474 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[6 (1576107795216859137)]} 0 3
[junit4] 2> 2293474 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[7 (1576107795216859138)]} 0 3
[junit4] 2> 2293475 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[8 (1576107795217907712)]} 0 4
[junit4] 2> 2293475 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[9 (1576107795217907713)]} 0 4
[junit4] 2> 2293475 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[10 (1576107795217907714)]} 0 4
[junit4] 2> 2293475 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[11 (1576107795217907715)]} 0 4
[junit4] 2> 2293475 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[12 (1576107795217907716)]} 0 4
[junit4] 2> 2293475 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[13 (1576107795217907717)]} 0 4
[junit4] 2> 2293476 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:1&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2293476 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[14 (1576107795218956288)]} 0 5
[junit4] 2> 2293476 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[15 (1576107795218956289)]} 0 5
[junit4] 2> 2293476 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:14&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2293476 ERROR (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//result[@numFound=1]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:q=id:14&qt=&start=0&rows=20&version=2.2
[junit4] 2> 2293477 ERROR (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=id:14&qt=&start=0&rows=20&version=2.2:java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:q=id:14&qt=&start=0&rows=20&version=2.2
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:879)
[junit4] 2> at org.apache.solr.update.AutoCommitTest.testMaxDocs(AutoCommitTest.java:225)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 2293477 INFO (TEST-AutoCommitTest.testMaxDocs-seed#[1130BB96224587D9]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testMaxDocs
[junit4] 2> 2293477 INFO (commitScheduler-7680-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=AutoCommitTest -Dtests.method=testMaxDocs -Dtests.seed=1130BB96224587D9 -Dtests.slow=true -Dtests.locale=de-DE -Dtests.timezone=America/Antigua -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.25s J1 | AutoCommitTest.testMaxDocs <<<
[junit4] > Throwable #1: java.lang.RuntimeException: Exception during query
[junit4] > at __randomizedtesting.SeedInfo.seed([1130BB96224587D9:A8B16D490EAF8353]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:886)
[junit4] > at org.apache.solr.update.AutoCommitTest.testMaxDocs(AutoCommitTest.java:225)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
[junit4] > xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] > <response>
[junit4] > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] > </response>
[junit4] > request was:q=id:14&qt=&start=0&rows=20&version=2.2
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:879)
[junit4] > ... 40 more
[junit4] 2> 2293477 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 2293477 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=472984354
[junit4] 2> 2293477 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2293478 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1efb8d02: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@acb62b
[junit4] 2> 2293478 INFO (commitScheduler-7680-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7ef7f4f7[collection1] main]
[junit4] 2> 2293478 INFO (commitScheduler-7680-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2293481 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2293481 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@35224bd3: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@27307916
[junit4] 2> 2293484 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2293484 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7d5b5b6f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@230fe928
[junit4] 2> 2293485 INFO (searcherExecutor-7677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7ef7f4f7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(7.1.0):c16)))}
[junit4] 2> 2293485 INFO (SUITE-AutoCommitTest-seed#[1130BB96224587D9]-worker) [ x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2293485 INFO (coreCloseExecutor-7681-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@258eddaf
[junit4] 2> 2293485 INFO (coreCloseExecutor-7681-thread-1-processing-x:collection1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=630119855
[junit4] 2> 2293485 INFO (coreCloseExecutor-7681-thread-1-processing-x:collection1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60d2590e: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@60d59cf2
[junit4] 2> 2293499 INFO (coreCloseExecutor-7681-thread-1-processing-x:collection1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 2293500 INFO (coreCloseExecutor-7681-thread-1-processing-x:collection1) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@36fff6bd commitCommandVersion:0
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.update.AutoCommitTest_1130BB96224587D9-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=de-DE, timezone=America/Antigua
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_141 (64-bit)/cpus=3,threads=1,free=146644712,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrCLIRunExample, MoreLikeThisHandlerTest, CursorMarkTest, JSONWriterTest, SpellingQueryConverterTest, TestApiFramework, TestDefaultStatsCache, RuleEngineTest, TestSolrDeletionPolicy1, TestUniqueKeyFieldResource, JsonLoaderTest, TestStressCloudBlindAtomicUpdates, TestRemoteStreaming, ForceLeaderTest, TestDynamicLoading, TestAnalyzeInfixSuggestions, TestMacroExpander, DistributedFacetExistsSmallTest, OpenCloseCoreStressTest, TestValueSourceCache, TestRequestStatusCollectionAPI, TestTrackingShardHandlerFactory, SearchHandlerTest, TestNumericRangeQuery64, TestCharFilters, BasicDistributedZk2Test, TestHdfsBackupRestoreCore, TestFastLRUCache, LeaderFailureAfterFreshStartTest, TermsComponentTest, TestManagedSchemaThreadSafety, TestUninvertingReader, ReplaceNodeTest, TermVectorComponentDistributedTest, SegmentsInfoRequestHandlerTest, WrapperMergePolicyFactoryTest, TestStressLucene, TestPostingsSolrHighlighter, TestInfoStreamLogging, TestSQLHandler, TestJoin, FileBasedSpellCheckerTest, LukeRequestHandlerTest, DistributedMLTComponentTest, TestLuceneMatchVersion, SubstringBytesRefFilterTest, TestJettySolrRunner, TestFieldSortValues, DocumentAnalysisRequestHandlerTest, TestShardHandlerFactory, PropertiesRequestHandlerTest, TestElisionMultitermQuery, TestDistributedMissingSort, ExternalFileFieldSortTest, TestDelegationWithHadoopAuth, HdfsTlogReplayBufferedWhileIndexingTest, LeaderInitiatedRecoveryOnShardRestartTest, ChaosMonkeySafeLeaderWithPullReplicasTest, TestRandomCollapseQParserPlugin, TestReRankQParserPlugin, TestDocTermOrds, MergeStrategyTest, SystemInfoHandlerTest, TestJsonFacetRefinement, SolrCLIZkUtilsTest, PluginInfoTest, DistributedTermsComponentTest, AssignBackwardCompatibilityTest, SolrXmlInZkTest, HdfsDirectoryTest, TestSlowCompositeReaderWrapper, TestRuleBasedAuthorizationPlugin, EchoParamsTest, TestScoreJoinQPNoScore, CdcrVersionReplicationTest, TestFieldCacheReopen, TestDistributedGrouping, TestPushWriter, ZkStateWriterTest, HdfsBasicDistributedZkTest, SSLMigrationTest, MultiThreadedOCPTest, MissingSegmentRecoveryTest, InfoHandlerTest, TestSolrCloudSnapshots, TestAnalyzedSuggestions, TestReqParamsAPI, HighlighterMaxOffsetTest, CdcrBootstrapTest, TestCopyFieldCollectionResource, TestDocSet, TestUseDocValuesAsStored, VMParamsZkACLAndCredentialsProvidersTest, TestCrossCoreJoin, DistributedQueryElevationComponentTest, SolrRequestParserTest, TestExportWriter, BasicAuthStandaloneTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, AddSchemaFieldsUpdateProcessorFactoryTest, SortSpecParsingTest, TestSizeLimitedDistributedMap, DebugComponentTest, TestMergePolicyConfig, TestChildDocTransformer, TestSolrCloudWithHadoopAuthPlugin, SpellCheckCollatorTest, CoreAdminRequestStatusTest, SampleTest, SolrCloudReportersTest, SolrCmdDistributorTest, TestMaxScoreQueryParser, SOLR749Test, TestFieldCacheSortRandom, TestJsonRequest, UpdateParamsTest, TestHttpShardHandlerFactory, TestZkChroot, MetricUtilsTest, TestBinaryResponseWriter, SuggesterTSTTest, AsyncCallRequestStatusResponseTest, TestFiltering, FileUtilsTest, OpenExchangeRatesOrgProviderTest, CacheHeaderTest, SolrIndexConfigTest, QueryEqualityTest, TestNRTOpen, TestPullReplicaErrorHandling, LeaderElectionIntegrationTest, CreateCollectionCleanupTest, DeleteInactiveReplicaTest, TestIndexSearcher, UtilsToolTest, SignatureUpdateProcessorFactoryTest, DistributedFacetPivotSmallTest, RecoveryAfterSoftCommitTest, DistribCursorPagingTest, HdfsWriteToMultipleCollectionsTest, CollectionReloadTest, MBeansHandlerTest, V2StandaloneTest, DeleteShardTest, StatelessScriptUpdateProcessorFactoryTest, TestPerFieldSimilarityWithDefaultOverride, DistributedSuggestComponentTest, MetricsConfigTest, OverseerTaskQueueTest, PreAnalyzedFieldManagedSchemaCloudTest, UpdateLogTest, TestLRUCache, PolyFieldTest, CdcrReplicationHandlerTest, TestWordDelimiterFilterFactory, BlockJoinFacetSimpleTest, TestRangeQuery, TestFieldTypeResource, ChangedSchemaMergeTest, BadComponentTest, TlogReplayBufferedWhileIndexingTest, TestInPlaceUpdatesDistrib, StatsComponentTest, TestRealTimeGet, TestCloudManagedSchema, SpellPossibilityIteratorTest, HttpSolrCallGetCoreTest, TestLocalFSCloudBackupRestore, CleanupOldIndexTest, SolrGraphiteReporterTest, ClassificationUpdateProcessorIntegrationTest, PreAnalyzedFieldTest, DocumentBuilderTest, ShardSplitTest, TemplateUpdateProcessorTest, TestLMJelinekMercerSimilarityFactory, TestSystemIdResolver, TestDFISimilarityFactory, TestSimpleQParserPlugin, BlockDirectoryTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, TestReplicationHandler, ZkCLITest, AutoCommitTest]
[junit4] Completed [379/729 (1!)] on J1 in 6.23s, 3 tests, 2 errors <<< FAILURES!
[...truncated 508 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_1130BB96224587D9-001/init-core-data-001
[junit4] 2> 3036537 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=146 numCloses=146
[junit4] 2> 3036537 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 3036538 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 3036538 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[1130BB96224587D9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 3036586 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[1130BB96224587D9]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_1130BB96224587D9-001/tempDir-001
[junit4] 2> 3036586 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[1130BB96224587D9]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3036586 INFO (Thread-8147) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3036586 INFO (Thread-8147) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3036590 ERROR (Thread-8147) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3036686 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[1130BB96224587D9]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:54875
[junit4] 2> 3036706 INFO (jetty-launcher-3602-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3036706 INFO (jetty-launcher-3602-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3036709 INFO (jetty-launcher-3602-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@73c210e6{/solr,null,AVAILABLE}
[junit4] 2> 3036709 INFO (jetty-launcher-3602-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fd9370d{/solr,null,AVAILABLE}
[junit4] 2> 3036710 INFO (jetty-launcher-3602-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@74ad9b9{SSL,[ssl, http/1.1]}{127.0.0.1:51954}
[junit4] 2> 3036710 INFO (jetty-launcher-3602-thread-1) [ ] o.e.j.s.Server Started @3040340ms
[junit4] 2> 3036710 INFO (jetty-launcher-3602-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51954}
[junit4] 2> 3036710 ERROR (jetty-launcher-3602-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3036710 INFO (jetty-launcher-3602-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 3036710 INFO (jetty-launcher-3602-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3036710 INFO (jetty-launcher-3602-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3036710 INFO (jetty-launcher-3602-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-18T22:11:07.536Z
[junit4] 2> 3036712 INFO (jetty-launcher-3602-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7b738d3e{SSL,[ssl, http/1.1]}{127.0.0.1:35095}
[junit4] 2> 3036713 INFO (jetty-launcher-3602-thread-2) [ ] o.e.j.s.Server Started @3040343ms
[junit4] 2> 3036713 INFO (jetty-launcher-3602-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35095}
[junit4] 2> 3036713 ERROR (jetty-launcher-3602-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3036713 INFO (jetty-launcher-3602-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 3036713 INFO (jetty-launcher-3602-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3036713 INFO (jetty-launcher-3602-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3036713 INFO (jetty-launcher-3602-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-08-18T22:11:07.539Z
[junit4] 2> 3036715 INFO (jetty-launcher-3602-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3036716 INFO (jetty-launcher-3602-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3036737 INFO (jetty-launcher-3602-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54875/solr
[junit4] 2> 3036738 INFO (jetty-launcher-3602-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54875/solr
[junit4] 2> 3036873 INFO (jetty-launcher-3602-thread-2) [n:127.0.0.1:35095_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3036873 INFO (jetty-launcher-3602-thread-1) [n:127.0.0.1:51954_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3036876 INFO (jetty-launcher-3602-thread-2) [n:127.0.0.1:35095_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35095_solr
[junit4] 2> 3036877 INFO (jetty-launcher-3602-thread-1) [n:127.0.0.1:51954_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51954_solr
[junit4] 2> 3036877 INFO (jetty-launcher-3602-thread-2) [n:127.0.0.1:35095_solr ] o.a.s.c.Overseer Overseer (id=98506785909243910-127.0.0.1:35095_solr-n_0000000000) starting
[junit4] 2> 3036880 INFO (zkCallback-3613-thread-1-processing-n:127.0.0.1:51954_solr) [n:127.0.0.1:51954_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3036882 INFO (zkCallback-3614-thread-1-processing-n:127.0.0.1:35095_solr) [n:127.0.0.1:35095_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3036895 INFO (jetty-launcher-3602-thread-2) [n:127.0.0.1:35095_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35095_solr
[junit4] 2> 3036896 INFO (zkCallback-3614-thread-1-processing-n:127.0.0.1:35095_solr) [n:127.0.0.1:35095_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3036896 INFO (zkCallback-3613-thread-1-processing-n:127.0.0.1:51954_solr) [n:127.0.0.1:51954_solr ] o.a.s.c.c
[...truncated too long message...]
ava:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Aug 18, 2017 10:11:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=bg-BG, timezone=Etc/GMT-10
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_141 (64-bit)/cpus=3,threads=1,free=134987632,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [SolrInfoBeanTest, TimeZoneUtilsTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestManagedSchemaAPI, TestHdfsUpdateLog, TestUseDocValuesAsStored2, DeleteLastCustomShardedReplicaTest, SecurityConfHandlerTest, AssignTest, SolrCoreTest, SolrTestCaseJ4Test, TestRequestForwarding, TestStressRecovery, TestFieldCollectionResource, TestConfigReload, CdcrUpdateLogTest, TestBulkSchemaConcurrent, DeleteStatusTest, DirectUpdateHandlerTest, TestLockTree, TestLMDirichletSimilarityFactory, TestBulkSchemaAPI, CollectionStateFormat2Test, TestSolrCoreSnapshots, TestLegacyTerms, TestRestoreCore, ShardRoutingTest, OverseerTest, CheckHdfsIndexTest, HighlighterConfigTest, TestFieldTypeCollectionResource, TestOrdValues, CloudExitableDirectoryReaderTest, TestSchemaSimilarityResource, CursorPagingTest, ParsingFieldUpdateProcessorsTest, BasicAuthIntegrationTest, CollectionsAPIAsyncDistributedZkTest, TestMaxTokenLenTokenizer, MultiTermTest, TestBackupRepositoryFactory, ReplicationFactorTest, TestPHPSerializedResponseWriter, TestSubQueryTransformerDistrib, TestPointFields, TestRebalanceLeaders, DocExpirationUpdateProcessorFactoryTest, TestCloudRecovery, GraphQueryTest, TestFieldCacheSort, JvmMetricsTest, TestComplexPhraseLeadingWildcard, TestPseudoReturnFields, TestEmbeddedSolrServerSchemaAPI, LeaderInitiatedRecoveryOnCommitTest, TestStreamBody, DirectSolrConnectionTest, LeaderFailoverAfterPartitionTest, TestClassicSimilarityFactory, CircularListTest, ConnectionManagerTest, TestSmileRequest, TestSolrQueryResponse, TestHashPartitioner, CustomCollectionTest, TestLegacyFieldCache, TestManagedStopFilterFactory, HLLSerializationTest, TestNoOpRegenerator, UnloadDistributedZkTest, UUIDUpdateProcessorFallbackTest, TestNumericRangeQuery32, NotRequiredUniqueKeyTest, TestManagedResourceStorage, V2ApiIntegrationTest, ReplicaListTransformerTest, NumericFieldsTest, SuggestComponentTest, ConcurrentDeleteAndCreateCollectionTest, HighlighterTest, TestQueryWrapperFilter, BlockCacheTest, WordBreakSolrSpellCheckerTest, ChaosMonkeyNothingIsSafeTest, HdfsRecoverLeaseTest, RecoveryZkTest, CoreMergeIndexesAdminHandlerTest, SolrShardReporterTest, TestCoreAdminApis, BaseCdcrDistributedZkTest, TestJsonFacets, TestOnReconnectListenerSupport, CdcrReplicationDistributedZkTest, ImplicitSnitchTest, HdfsUnloadDistributedZkTest, PrimitiveFieldTypeTest, TestDistribDocBasedVersion, AliasIntegrationTest, SearchHandlerTest, XmlUpdateRequestHandlerTest, SolrJmxReporterCloudTest, TestMissingGroups, TestStressInPlaceUpdates, TestAuthenticationFramework, HardAutoCommitTest, TestCollectionsAPIViaSolrCloudCluster, OverriddenZkACLAndCredentialsProvidersTest, PeerSyncWithIndexFingerprintCachingTest, FastVectorHighlighterTest, TestSha256AuthenticationProvider, TestDynamicFieldCollectionResource, TestStressReorder, TestLegacyFieldReuse, AlternateDirectoryTest, TestExactStatsCache, TestRawResponseWriter, TestRTimerTree, SimpleFacetsTest, TestStandardQParsers, MoveReplicaTest, TestUpdate, MoveReplicaHDFSTest, DistributedExpandComponentTest, TestStressVersions, SparseHLLTest, SliceStateTest, ExplicitHLLTest, IndexBasedSpellCheckerTest, TestSolrCloudWithDelegationTokens, TestRandomDVFaceting, ClusterStateTest, XsltUpdateRequestHandlerTest, TestLegacyNumericRangeQueryBuilder, CoreAdminHandlerTest, DisMaxRequestHandlerTest, TestGeoJSONResponseWriter, TestCSVResponseWriter, QueryParsingTest, SaslZkACLProviderTest, OverseerStatusTest, ScriptEngineTest, NodeMutatorTest, TestExtendedDismaxParser, TestTrieFacet, TestFunctionQuery, TestReversedWildcardFilterFactory, SmileWriterTest, TestShortCircuitedRequests, MinimalSchemaTest, SuggesterTest, IndexSchemaTest, RankQueryTest, JavabinLoaderTest, DistributedFacetPivotLargeTest, LargeFieldTest, HdfsLockFactoryTest, DeleteReplicaTest, TestSort, CurrencyFieldTypeTest, TestLeaderElectionWithEmptyReplica, SpatialHeatmapFacetsTest, PathHierarchyTokenizerFactoryTest, TestQuerySenderNoQuery, DirectUpdateHandlerOptimizeTest, TestSolrDeletionPolicy2, SolrCloudExampleTest, TestTestInjection, DistributedQueueTest, TestLazyCores, SuggesterWFSTTest, TestAtomicUpdateErrorCases, PeerSyncReplicationTest, DateMathParserTest, MigrateRouteKeyTest, TestQuerySenderListener, SyncSliceTest, BasicZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, ZkSolrClientTest, ShardRoutingCustomTest, TestDistributedSearch, TestReload, TestSolr4Spatial, QueryElevationComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, BasicFunctionalityTest, TestBadConfig, SoftAutoCommitTest, CSVRequestHandlerTest, TestComponentsName, TestLFUCache, TestSolrIndexConfig, CopyFieldTest, ResponseLogComponentTest, TestBinaryField, TestSearchPerf, TestConfig, OutputWriterTest, TestSolrCoreProperties, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestBM25SimilarityFactory, ResourceLoaderTest, URLClassifyProcessorTest, TestSuggestSpellingConverter, DateFieldTest, RAMDirectoryFactoryTest, TestDocumentBuilder, TestRTGBase, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, TestTolerantSearch, ActionThrottleTest, CdcrRequestHandlerTest, CollectionTooManyReplicasTest, ConfigSetsAPITest, DeleteNodeTest, DistribDocExpirationUpdateProcessorTest, DocValuesNotIndexedTest, HttpPartitionTest, SharedFSAutoReplicaFailoverTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, TestCloudInspectUtil, TestCloudJSONFacetJoinDomain, TestCloudPseudoReturnFields, TestCloudSearcherWarming, TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestDeleteCollectionOnDownNodes, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestHdfsCloudBackupRestore, TestLeaderElectionZkExpiry, TestMiniSolrCloudClusterSSL, TestPullReplica, TestReplicaProperties, TestSegmentSorting, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=1130BB96224587D9 -Dtests.slow=true -Dtests.locale=bg-BG -Dtests.timezone=Etc/GMT-10 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=26295, name=jetty-launcher-3602-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([1130BB96224587D9]:0)
[junit4] Completed [539/729 (2!)] on J0 in 48.48s, 12 tests, 1 error <<< FAILURES!
[...truncated 44015 lines...]