You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/05/02 17:11:38 UTC
[JENKINS] Lucene-Solr-7.3-Linux (64bit/jdk1.8.0_162) - Build # 162
- Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.3-Linux/162/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.TestPullReplica.testKillLeader
Error Message:
Replica core_node4 not up to date after 10 seconds expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: Replica core_node4 not up to date after 10 seconds expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([37F8D1201325D1D2:7EEE2594719E4584]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.TestPullReplica.waitForNumDocsInAllReplicas(TestPullReplica.java:538)
at org.apache.solr.cloud.TestPullReplica.doTestNoLeader(TestPullReplica.java:486)
at org.apache.solr.cloud.TestPullReplica.testKillLeader(TestPullReplica.java:305)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12965 lines...]
[junit4] Suite: org.apache.solr.cloud.TestPullReplica
[junit4] 2> 534442 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/init-core-data-001
[junit4] 2> 534442 WARN (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=40 numCloses=40
[junit4] 2> 534442 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 534456 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 534457 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001
[junit4] 2> 534457 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 534471 INFO (Thread-1346) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 534471 INFO (Thread-1346) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 534507 ERROR (Thread-1346) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 534574 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:45787
[junit4] 2> 534611 INFO (zkConnectionManagerCallback-1492-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534636 INFO (jetty-launcher-1489-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 534642 INFO (jetty-launcher-1489-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 534727 INFO (jetty-launcher-1489-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 534727 INFO (jetty-launcher-1489-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 534727 INFO (jetty-launcher-1489-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 534735 INFO (jetty-launcher-1489-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7247b33a{/solr,null,AVAILABLE}
[junit4] 2> 534735 INFO (jetty-launcher-1489-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3e5c57a1{SSL,[ssl, http/1.1]}{127.0.0.1:38263}
[junit4] 2> 534736 INFO (jetty-launcher-1489-thread-1) [ ] o.e.j.s.Server Started @536065ms
[junit4] 2> 534736 INFO (jetty-launcher-1489-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38263}
[junit4] 2> 534736 ERROR (jetty-launcher-1489-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 534736 INFO (jetty-launcher-1489-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.1
[junit4] 2> 534736 INFO (jetty-launcher-1489-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 534736 INFO (jetty-launcher-1489-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 534736 INFO (jetty-launcher-1489-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-02T16:15:59.605Z
[junit4] 2> 534777 INFO (jetty-launcher-1489-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 534777 INFO (jetty-launcher-1489-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 534778 INFO (jetty-launcher-1489-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 534791 INFO (jetty-launcher-1489-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@633018f6{/solr,null,AVAILABLE}
[junit4] 2> 534791 INFO (jetty-launcher-1489-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@67e071e1{SSL,[ssl, http/1.1]}{127.0.0.1:42271}
[junit4] 2> 534792 INFO (jetty-launcher-1489-thread-2) [ ] o.e.j.s.Server Started @536121ms
[junit4] 2> 534792 INFO (jetty-launcher-1489-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42271}
[junit4] 2> 534792 ERROR (jetty-launcher-1489-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 534792 INFO (jetty-launcher-1489-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.1
[junit4] 2> 534792 INFO (jetty-launcher-1489-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 534792 INFO (jetty-launcher-1489-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 534792 INFO (jetty-launcher-1489-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-02T16:15:59.661Z
[junit4] 2> 534807 INFO (zkConnectionManagerCallback-1494-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534807 INFO (jetty-launcher-1489-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 534859 INFO (zkConnectionManagerCallback-1496-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534860 INFO (jetty-launcher-1489-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 534866 INFO (jetty-launcher-1489-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45787/solr
[junit4] 2> 534882 INFO (jetty-launcher-1489-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45787/solr
[junit4] 2> 534896 INFO (zkConnectionManagerCallback-1500-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534900 INFO (zkConnectionManagerCallback-1504-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534902 INFO (zkConnectionManagerCallback-1506-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534913 INFO (zkConnectionManagerCallback-1508-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534919 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 534920 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42271_solr
[junit4] 2> 534924 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.c.Overseer Overseer (id=72093229387874310-127.0.0.1:42271_solr-n_0000000000) starting
[junit4] 2> 534931 INFO (zkConnectionManagerCallback-1514-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534935 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45787/solr ready
[junit4] 2> 534947 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42271_solr
[junit4] 2> 534950 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 534989 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 534990 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 534991 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 534993 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38263_solr
[junit4] 2> 534997 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 534997 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 534997 INFO (zkCallback-1505-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 534999 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 535004 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 535004 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 535006 INFO (jetty-launcher-1489-thread-2) [n:127.0.0.1:42271_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node2/.
[junit4] 2> 535040 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38263.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 535047 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38263.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 535047 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38263.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 535049 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node1/.
[junit4] 2> 535072 INFO (zkConnectionManagerCallback-1518-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 535072 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 535073 INFO (jetty-launcher-1489-thread-1) [n:127.0.0.1:38263_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45787/solr ready
[junit4] 2> 535179 INFO (zkConnectionManagerCallback-1520-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 535203 INFO (zkConnectionManagerCallback-1524-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 535211 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 535211 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45787/solr ready
[junit4] 2> 535214 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.c.TestPullReplica Using legacyCloud?: false
[junit4] 2> 535246 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 535256 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=9
[junit4] 2> 535294 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testKillPullReplica
[junit4] 2> 535295 INFO (qtp1403444624-6365) [n:127.0.0.1:38263_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=1&replicationFactor=1&collection.configName=conf&maxShardsPerNode=100&name=pull_replica_test_kill_pull_replica&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 535300 INFO (OverseerThreadFactory-2529-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection pull_replica_test_kill_pull_replica
[junit4] 2> 535411 INFO (OverseerStateUpdate-72093229387874310-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_kill_pull_replica",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_kill_pull_replica_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38263/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 535414 INFO (OverseerStateUpdate-72093229387874310-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_kill_pull_replica",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_kill_pull_replica_shard1_replica_p3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42271/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 535657 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=pull_replica_test_kill_pull_replica_shard1_replica_n1&action=CREATE&numShards=1&collection=pull_replica_test_kill_pull_replica&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 535658 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 535665 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=pull_replica_test_kill_pull_replica_shard1_replica_p3&action=CREATE&numShards=1&collection=pull_replica_test_kill_pull_replica&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 535666 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 535772 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 535772 INFO (zkCallback-1505-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 535772 INFO (zkCallback-1507-thread-2-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 535772 INFO (zkCallback-1505-thread-2-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536672 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.1
[junit4] 2> 536678 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.1
[junit4] 2> 536679 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.s.IndexSchema [pull_replica_test_kill_pull_replica_shard1_replica_n1] Schema name=minimal
[junit4] 2> 536683 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 536683 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_kill_pull_replica_shard1_replica_n1' using configuration from collection pull_replica_test_kill_pull_replica, trusted=true
[junit4] 2> 536685 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38263.solr.core.pull_replica_test_kill_pull_replica.shard1.replica_n1' (registry 'solr.core.pull_replica_test_kill_pull_replica.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 536685 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 536686 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SolrCore [[pull_replica_test_kill_pull_replica_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node1/pull_replica_test_kill_pull_replica_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node1/./pull_replica_test_kill_pull_replica_shard1_replica_n1/data/]
[junit4] 2> 536687 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.IndexSchema [pull_replica_test_kill_pull_replica_shard1_replica_p3] Schema name=minimal
[junit4] 2> 536689 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 536689 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_kill_pull_replica_shard1_replica_p3' using configuration from collection pull_replica_test_kill_pull_replica, trusted=true
[junit4] 2> 536690 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.core.pull_replica_test_kill_pull_replica.shard1.replica_p3' (registry 'solr.core.pull_replica_test_kill_pull_replica.shard1.replica_p3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 536690 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 536690 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore [[pull_replica_test_kill_pull_replica_shard1_replica_p3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node2/pull_replica_test_kill_pull_replica_shard1_replica_p3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node2/./pull_replica_test_kill_pull_replica_shard1_replica_p3/data/]
[junit4] 2> 536735 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 536735 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 536737 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 536737 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 536738 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2c982b9f[pull_replica_test_kill_pull_replica_shard1_replica_n1] main]
[junit4] 2> 536739 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 536739 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 536740 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 536740 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599369654156918784
[junit4] 2> 536742 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 536742 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 536742 INFO (searcherExecutor-2534-thread-1-processing-n:127.0.0.1:38263_solr x:pull_replica_test_kill_pull_replica_shard1_replica_n1 s:shard1 c:pull_replica_test_kill_pull_replica r:core_node2) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SolrCore [pull_replica_test_kill_pull_replica_shard1_replica_n1] Registered new searcher Searcher@2c982b9f[pull_replica_test_kill_pull_replica_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 536743 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/pull_replica_test_kill_pull_replica/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 536744 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b814426[pull_replica_test_kill_pull_replica_shard1_replica_p3] main]
[junit4] 2> 536744 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 536744 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 536745 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 536745 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 536745 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38263/solr/pull_replica_test_kill_pull_replica_shard1_replica_n1/
[junit4] 2> 536745 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 536745 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:38263/solr/pull_replica_test_kill_pull_replica_shard1_replica_n1/ has no replicas
[junit4] 2> 536745 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 536745 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 536746 INFO (searcherExecutor-2535-thread-1-processing-n:127.0.0.1:42271_solr x:pull_replica_test_kill_pull_replica_shard1_replica_p3 s:shard1 c:pull_replica_test_kill_pull_replica r:core_node4) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore [pull_replica_test_kill_pull_replica_shard1_replica_p3] Registered new searcher Searcher@1b814426[pull_replica_test_kill_pull_replica_shard1_replica_p3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 536747 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38263/solr/pull_replica_test_kill_pull_replica_shard1_replica_n1/ shard1
[junit4] 2> 536747 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.ZkController pull_replica_test_kill_pull_replica_shard1_replica_p3 starting background replication from leader
[junit4] 2> 536747 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 536748 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 536749 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 536848 INFO (zkCallback-1507-thread-3-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536848 INFO (zkCallback-1507-thread-2-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536848 INFO (zkCallback-1505-thread-2-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536848 INFO (zkCallback-1505-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536849 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Replica core_node2 is leader but it's state is down, skipping replication
[junit4] 2> 536850 INFO (qtp404197941-6370) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=pull_replica_test_kill_pull_replica_shard1_replica_p3&action=CREATE&numShards=1&collection=pull_replica_test_kill_pull_replica&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1184
[junit4] 2> 536897 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 536898 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=pull_replica_test_kill_pull_replica_shard1_replica_n1&action=CREATE&numShards=1&collection=pull_replica_test_kill_pull_replica&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1241
[junit4] 2> 536900 INFO (qtp1403444624-6365) [n:127.0.0.1:38263_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 536999 INFO (zkCallback-1505-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536999 INFO (zkCallback-1507-thread-3-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536999 INFO (zkCallback-1505-thread-2-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 536999 INFO (zkCallback-1507-thread-2-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 537301 INFO (OverseerCollectionConfigSetProcessor-72093229387874310-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 537900 INFO (qtp1403444624-6365) [n:127.0.0.1:38263_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=1&replicationFactor=1&collection.configName=conf&maxShardsPerNode=100&name=pull_replica_test_kill_pull_replica&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2604
[junit4] 2> 537906 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 537910 INFO (qtp404197941-6375) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 537919 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/pull_replica_test_kill_pull_replica/terms/shard1 to Terms{values={core_node2=1}, version=1}
[junit4] 2> 537919 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1599369655384801280)]} 0 7
[junit4] 2> 537920 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1599369655394238464,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 537920 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@9040016 commitCommandVersion:1599369655394238464
[junit4] 2> 537922 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2f73b8a6[pull_replica_test_kill_pull_replica_shard1_replica_n1] main]
[junit4] 2> 537922 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 537923 INFO (searcherExecutor-2534-thread-1-processing-n:127.0.0.1:38263_solr x:pull_replica_test_kill_pull_replica_shard1_replica_n1 s:shard1 c:pull_replica_test_kill_pull_replica r:core_node2) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SolrCore [pull_replica_test_kill_pull_replica_shard1_replica_n1] Registered new searcher Searcher@2f73b8a6[pull_replica_test_kill_pull_replica_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.1):C1)))}
[junit4] 2> 537923 INFO (qtp1403444624-6360) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=pull_replica_test_kill_pull_replica:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 3
[junit4] 2> 537929 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 537932 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538033 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538134 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538235 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538336 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538437 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538537 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538638 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538739 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538840 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 538941 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539042 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539143 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539244 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539347 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539448 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539549 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539650 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539748 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
[junit4] 2> 539749 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:38263/solr/pull_replica_test_kill_pull_replica_shard1_replica_n1/
[junit4] 2> 539751 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 539751 INFO (qtp404197941-6371) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 539751 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 539751 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Master's version: 1525277762789
[junit4] 2> 539751 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 539751 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 539751 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 539752 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&tlogFiles=false&wt=javabin&version=2&command=filelist} status=0 QTime=0
[junit4] 2> 539752 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Number of files in latest index in master: 13
[junit4] 2> 539753 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Starting download (fullCopy=true) to MockDirectoryWrapper(RAMDirectory@60106c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@74d3f82a)
[junit4] 2> 539753 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539759 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539763 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.tim&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539764 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.pos&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539765 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539766 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539767 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.tip&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539768 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539769 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539771 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539773 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539774 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539775 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 539776 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=true,bytesDownloaded=2322) : 0 secs (null bytes/sec) to MockDirectoryWrapper(RAMDirectory@60106c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@74d3f82a)
[junit4] 2> 539776 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore Updating index properties... index=index.20180502111604621
[junit4] 2> 539776 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.IndexFetcher removing old index directory MockDirectoryWrapper(RAMDirectory@348879e9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2b9c0720)
[junit4] 2> 539777 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 539777 INFO (indexFetcher-2544-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.SolrIndexSearcher Opening [Searcher@36924f56[pull_replica_test_kill_pull_replica_shard1_replica_p3] main]
[junit4] 2> 539778 INFO (searcherExecutor-2535-thread-1-processing-n:127.0.0.1:42271_solr x:pull_replica_test_kill_pull_replica_shard1_replica_p3 s:shard1 c:pull_replica_test_kill_pull_replica r:core_node4) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore [pull_replica_test_kill_pull_replica_shard1_replica_p3] Registered new searcher Searcher@36924f56[pull_replica_test_kill_pull_replica_shard1_replica_p3] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.1):C1)))}
[junit4] 2> 539852 INFO (qtp404197941-6376) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_p3] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 539853 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.ChaosMonkey monkey: kill jetty! 42271
[junit4] 2> 539854 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@67e071e1{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 539855 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=770335840
[junit4] 2> 539855 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 539855 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15873e13: rootName = solr_42271, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@58693049
[junit4] 2> 539862 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 539862 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@35bd2264: rootName = solr_42271, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7410497a
[junit4] 2> 539865 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 539865 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28bb1337: rootName = solr_42271, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@715f77f4
[junit4] 2> 539866 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42271_solr
[junit4] 2> 539867 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 539867 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 539867 INFO (zkCallback-1505-thread-2-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 539867 INFO (zkCallback-1517-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 539867 INFO (zkCallback-1523-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 539867 INFO (zkCallback-1507-thread-2-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 539868 INFO (zkCallback-1507-thread-3-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [1])
[junit4] 2> 539868 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [1])
[junit4] 2> 539868 INFO (zkCallback-1505-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [1])
[junit4] 2> 539868 INFO (zkCallback-1505-thread-3-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [1])
[junit4] 2> 539870 INFO (coreCloseExecutor-2546-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore [pull_replica_test_kill_pull_replica_shard1_replica_p3] CLOSING SolrCore org.apache.solr.core.SolrCore@7aca31c
[junit4] 2> 539870 INFO (coreCloseExecutor-2546-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.pull_replica_test_kill_pull_replica.shard1.replica_p3, tag=128754460
[junit4] 2> 539870 INFO (coreCloseExecutor-2546-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@34930945: rootName = solr_42271, domain = solr.core.pull_replica_test_kill_pull_replica.shard1.replica_p3, service url = null, agent id = null] for registry solr.core.pull_replica_test_kill_pull_replica.shard1.replica_p3 / com.codahale.metrics.MetricRegistry@9b902fb
[junit4] 2> 539879 INFO (coreCloseExecutor-2546-thread-1) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.pull_replica_test_kill_pull_replica.shard1.leader, tag=128754460
[junit4] 2> 539881 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.Overseer Overseer (id=72093229387874310-127.0.0.1:42271_solr-n_0000000000) closing
[junit4] 2> 539881 INFO (OverseerStateUpdate-72093229387874310-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42271_solr
[junit4] 2> 539882 WARN (OverseerAutoScalingTriggerThread-72093229387874310-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 539891 INFO (zkCallback-1505-thread-3-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38263_solr
[junit4] 2> 539891 INFO (zkCallback-1505-thread-3-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.Overseer Overseer (id=72093229387874309-127.0.0.1:38263_solr-n_0000000001) starting
[junit4] 2> 539907 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@633018f6{/solr,null,UNAVAILABLE}
[junit4] 2> 539907 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 539911 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 42271
[junit4] 2> 539922 INFO (qtp1403444624-6363) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1599369657492439040)]} 0 1
[junit4] 2> 539929 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1599369657500827648,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 539930 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@9040016 commitCommandVersion:1599369657500827648
[junit4] 2> 539933 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@40fa2e0c[pull_replica_test_kill_pull_replica_shard1_replica_n1] main]
[junit4] 2> 539933 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 539934 INFO (searcherExecutor-2534-thread-1-processing-n:127.0.0.1:38263_solr x:pull_replica_test_kill_pull_replica_shard1_replica_n1 s:shard1 c:pull_replica_test_kill_pull_replica r:core_node2) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.SolrCore [pull_replica_test_kill_pull_replica_shard1_replica_n1] Registered new searcher Searcher@40fa2e0c[pull_replica_test_kill_pull_replica_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.1):C1) Uninverting(_1(7.3.1):C1)))}
[junit4] 2> 539935 INFO (qtp1403444624-6364) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=pull_replica_test_kill_pull_replica:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
[junit4] 2> 539938 INFO (qtp1403444624-6427) [n:127.0.0.1:38263_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node2 x:pull_replica_test_kill_pull_replica_shard1_replica_n1] o.a.s.c.S.Request [pull_replica_test_kill_pull_replica_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=2 status=0 QTime=0
[junit4] 2> 539939 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.ChaosMonkey monkey: starting jetty! 42271
[junit4] 2> 539940 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 539963 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 539963 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 539963 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 539963 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@106f7866{/solr,null,AVAILABLE}
[junit4] 2> 539964 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4bb4ea3c{SSL,[ssl, http/1.1]}{127.0.0.1:42271}
[junit4] 2> 539964 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.e.j.s.Server Started @541293ms
[junit4] 2> 539964 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42271}
[junit4] 2> 539964 ERROR (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 539967 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.1
[junit4] 2> 539967 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 539967 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 539967 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-02T16:16:04.836Z
[junit4] 2> 539969 INFO (zkConnectionManagerCallback-1526-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 539969 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 539978 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45787/solr
[junit4] 2> 539979 INFO (zkConnectionManagerCallback-1530-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 539981 INFO (zkConnectionManagerCallback-1532-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 539985 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 539986 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 539987 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42271_solr
[junit4] 2> 539988 INFO (zkCallback-1505-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [1])
[junit4] 2> 539988 INFO (zkCallback-1505-thread-2-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_kill_pull_replica/state.json] for collection [pull_replica_test_kill_pull_replica] has occurred - updating... (live nodes size: [1])
[junit4] 2> 539988 INFO (zkCallback-1517-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 539988 INFO (zkCallback-1523-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 539989 INFO (zkCallback-1531-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 539990 INFO (zkCallback-1505-thread-3-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 540033 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 540041 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 540041 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 540043 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node2/.
[junit4] 2> 540043 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.c.CorePropertiesLocator Cores are: [pull_replica_test_kill_pull_replica_shard1_replica_p3]
[junit4] 2> 540043 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 540070 INFO (zkConnectionManagerCallback-1537-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 540071 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 540071 INFO (TEST-TestPullReplica.testKillPullReplica-seed#[37F8D1201325D1D2]) [n:127.0.0.1:42271_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45787/solr ready
[junit4] 2> 540132 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.1
[junit4] 2> 540137 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.s.IndexSchema [pull_replica_test_kill_pull_replica_shard1_replica_p3] Schema name=minimal
[junit4] 2> 540139 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 540145 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.1
[junit4] 2> 540151 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.IndexSchema [pull_replica_test_kill_pull_replica_shard1_replica_p3] Schema name=minimal
[junit4] 2> 540153 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 540153 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_kill_pull_replica_shard1_replica_p3' using configuration from collection pull_replica_test_kill_pull_replica, trusted=true
[junit4] 2> 540154 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.core.pull_replica_test_kill_pull_replica.shard1.replica_p3' (registry 'solr.core.pull_replica_test_kill_pull_replica.shard1.replica_p3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39b087ec
[junit4] 2> 540154 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 540154 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore [[pull_replica_test_kill_pull_replica_shard1_replica_p3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node2/pull_replica_test_kill_pull_replica_shard1_replica_p3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001/tempDir-001/node2/./pull_replica_test_kill_pull_replica_shard1_replica_p3/data/]
[junit4] 2> 540189 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 540189 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 540190 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.s.SolrIndexSearcher Opening [Searcher@5d2a2410[pull_replica_test_kill_pull_replica_shard1_replica_p3] main]
[junit4] 2> 540191 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 540191 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 540191 INFO (coreLoadExecutor-2557-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 540192 INFO (searcherExecutor-2558-thread-1-processing-n:127.0.0.1:42271_solr x:pull_replica_test_kill_pull_replica_shard1_replica_p3 s:shard1 c:pull_replica_test_kill_pull_replica r:core_node4) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.SolrCore [pull_replica_test_kill_pull_replica_shard1_replica_p3] Registered new searcher Searcher@5d2a2410[pull_replica_test_kill_pull_replica_shard1_replica_p3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 540193 INFO (coreZkRegister-2552-thread-1-processing-n:127.0.0.1:42271_solr x:pull_replica_test_kill_pull_replica_shard1_replica_p3 s:shard1 c:pull_replica_test_kill_pull_replica r:core_node4) [n:127.0.0.1:42271_solr c:pull_replica_test_kill_pull_replica s:shard1 r:core_node4 x:pull_replica_test_kill_pull_replica_shard1_replica_p3] o.a.s.c.ZkController pull_replica_test_kill_pull_replica_shard1_replica_p3 starting ba
[...truncated too long message...]
olr.jetty / com.codahale.metrics.MetricRegistry@715f77f4
[junit4] 2> 635630 INFO (jetty-closer-1490-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42271_solr
[junit4] 2> 635630 INFO (jetty-closer-1490-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 635631 INFO (zkCallback-1545-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 635631 INFO (zkCallback-1536-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 635631 INFO (zkCallback-1531-thread-2-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 635631 INFO (zkCallback-1550-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 635632 INFO (jetty-closer-1490-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72093229387874317-127.0.0.1:42271_solr-n_0000000002) closing
[junit4] 2> 635632 INFO (OverseerStateUpdate-72093229387874317-127.0.0.1:42271_solr-n_0000000002) [n:127.0.0.1:42271_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42271_solr
[junit4] 2> 635632 WARN (OverseerAutoScalingTriggerThread-72093229387874317-127.0.0.1:42271_solr-n_0000000002) [n:127.0.0.1:42271_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 635634 INFO (zkCallback-1545-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38263_solr
[junit4] 2> 635635 INFO (jetty-closer-1490-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 635635 INFO (jetty-closer-1490-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@106f7866{/solr,null,UNAVAILABLE}
[junit4] 2> 635635 INFO (jetty-closer-1490-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@52c7f31d: rootName = solr_38263, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@715f77f4
[junit4] 2> 635635 INFO (jetty-closer-1490-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 635636 INFO (jetty-closer-1490-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38263_solr
[junit4] 2> 635636 INFO (jetty-closer-1490-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 635636 INFO (zkCallback-1550-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 635636 INFO (zkCallback-1545-thread-1-processing-n:127.0.0.1:38263_solr) [n:127.0.0.1:38263_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 635637 INFO (jetty-closer-1490-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3e6a8c1a{/solr,null,UNAVAILABLE}
[junit4] 2> 635637 INFO (jetty-closer-1490-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 635638 ERROR (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 635638 INFO (SUITE-TestPullReplica-seed#[37F8D1201325D1D2]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45787 45787
[junit4] 2> 635762 INFO (Thread-1346) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45787 45787
[junit4] 2> 635763 WARN (Thread-1346) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 17 /solr/configs/conf
[junit4] 2> 17 /solr/collections/pull_replica_test_remove_all_writer_replicas/terms/shard1
[junit4] 2> 13 /solr/collections/pull_replica_test_create_delete/terms/shard2
[junit4] 2> 13 /solr/collections/pull_replica_test_real_time_get/terms/shard1
[junit4] 2> 11 /solr/collections/pull_replica_test_create_delete/terms/shard1
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 9 /solr/collections/pull_replica_test_kill_leader/terms/shard1
[junit4] 2> 8 /solr/collections/pull_replica_test_kill_pull_replica/terms/shard1
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/collections/pull_replica_test_add_remove_pull_replica/terms/shard2
[junit4] 2> 3 /solr/collections/pull_replica_test_add_remove_pull_replica/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 34 /solr/collections/pull_replica_test_create_delete/state.json
[junit4] 2> 27 /solr/collections/pull_replica_test_real_time_get/state.json
[junit4] 2> 24 /solr/collections/pull_replica_test_kill_leader/state.json
[junit4] 2> 21 /solr/collections/pull_replica_test_kill_pull_replica/state.json
[junit4] 2> 20 /solr/collections/pull_replica_test_remove_all_writer_replicas/state.json
[junit4] 2> 18 /solr/collections/pull_replica_test_add_remove_pull_replica/state.json
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 3 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/live_nodes
[junit4] 2> 9 /solr/collections
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplica_37F8D1201325D1D2-001
[junit4] 2> May 02, 2018 4:17:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=6, maxDocsPerChunk=995, blockSize=8), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=6, blockSize=8)), sim=RandomSimilarity(queryNorm=false): {}, locale=mt, timezone=America/Merida
[junit4] 2> NOTE: Linux 4.13.0-39-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=159604480,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestAnalyzedSuggestions, SuggestComponentTest, TestGraphTermsQParserPlugin, ReplaceNodeTest, TestLFUCache, RankQueryTest, DirectSolrSpellCheckerTest, DistanceFunctionTest, HdfsCollectionsAPIDistributedZkTest, TestTestInjection, DeleteLastCustomShardedReplicaTest, TestUniqueKeyFieldResource, PingRequestHandlerTest, TestSolrCloudWithHadoopAuthPlugin, TestMiniSolrCloudClusterSSL, AutoAddReplicasIntegrationTest, TestCoreDiscovery, TestClusterStateProvider, TestValueSourceCache, SharedFSAutoReplicaFailoverTest, TestStressInPlaceUpdates, AnalysisAfterCoreReloadTest, TestUtils, TestConfigSetsAPIExclusivity, SubstringBytesRefFilterTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestLegacyNumericRangeQueryBuilder, DeleteShardTest, TestCollapseQParserPlugin, CoreAdminRequestStatusTest, TestNumericRangeQuery32, TestRandomRequestDistribution, CdcrReplicationHandlerTest, HdfsChaosMonkeyNothingIsSafeTest, TestCloudSearcherWarming, ClusterStateTest, HdfsRecoverLeaseTest, TestTolerantUpdateProcessorCloud, TestSSLRandomization, TestSubQueryTransformerCrossCore, CreateCollectionCleanupTest, URLClassifyProcessorTest, VersionInfoTest, TestSolrCoreParser, ComputePlanActionTest, MetricsHandlerTest, TestSimpleTextCodec, TestReplicationHandlerBackup, BlockDirectoryTest, CloudMLTQParserTest, HttpPartitionOnCommitTest, TestXmlQParserPlugin, SearchHandlerTest, TimeZoneUtilsTest, TestLazyCores, TestSolrCloudSnapshots, TestLocalFSCloudBackupRestore, TestPullReplica]
[junit4] Completed [237/783 (1!)] on J2 in 101.87s, 10 tests, 1 failure, 2 skipped <<< FAILURES!
[...truncated 51467 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.3-Linux/162/consoleText
[repro] Revision: 7b74345edb3969ffc523284b116a0437a275102a
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=TestPullReplica -Dtests.method=testKillLeader -Dtests.seed=37F8D1201325D1D2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mt -Dtests.timezone=America/Merida -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestPullReplica
[repro] ant compile-test
[...truncated 3310 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestPullReplica" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC" -Dtests.seed=37F8D1201325D1D2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mt -Dtests.timezone=America/Merida -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 111 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.TestPullReplica
[repro] Exiting with code 0
[...truncated 40 lines...]
[JENKINS-EA] Lucene-Solr-7.3-Linux (64bit/jdk-11-ea+5) - Build #
163 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.3-Linux/163/
Java: 64bit/jdk-11-ea+5 -XX:+UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.TestDistributedSearch.test
Error Message:
IOException occured when talking to server at: http://127.0.0.1:42583//collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:42583//collection1
at __randomizedtesting.SeedInfo.seed([35FADDAD4CD3D3AD:BDAEE277E22FBE55]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:542)
at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:1034)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1019)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:841)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:42583 failed to respond
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 48 more
FAILED: org.apache.solr.TestDistributedSearch.test
Error Message:
Error from server at http://127.0.0.1:43963//collection1: java.lang.NullPointerException at org.apache.solr.search.grouping.distributed.responseprocessor.StoredFieldsShardResponseProcessor.process(StoredFieldsShardResponseProcessor.java:38) at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:579) at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:562) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:423) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2503) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:711) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:517) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:384) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:530) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base/java.lang.Thread.run(Thread.java:841)
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43963//collection1: java.lang.NullPointerException
at org.apache.solr.search.grouping.distributed.responseprocessor.StoredFieldsShardResponseProcessor.process(StoredFieldsShardResponseProcessor.java:38)
at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:579)
at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:562)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:423)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2503)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:711)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:517)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:384)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
at org.eclipse.jetty.server.Server.handle(Server.java:530)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.base/java.lang.Thread.run(Thread.java:841)
at __randomizedtesting.SeedInfo.seed([35FADDAD4CD3D3AD:BDAEE277E22FBE55]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
at org.apache.solr.TestDistributedSearch.queryRandomUpServer(TestDistributedSearch.java:1168)
at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1130)
at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:992)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1019)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:841)
Build Log:
[...truncated 13555 lines...]
[junit4] Suite: org.apache.solr.TestDistributedSearch
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/init-core-data-001
[junit4] 2> 979356 WARN (SUITE-TestDistributedSearch-seed#[35FADDAD4CD3D3AD]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2367 numCloses=2367
[junit4] 2> 979356 INFO (SUITE-TestDistributedSearch-seed#[35FADDAD4CD3D3AD]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 979357 INFO (SUITE-TestDistributedSearch-seed#[35FADDAD4CD3D3AD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-9061")
[junit4] 2> 979357 INFO (SUITE-TestDistributedSearch-seed#[35FADDAD4CD3D3AD]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 979357 INFO (SUITE-TestDistributedSearch-seed#[35FADDAD4CD3D3AD]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 979444 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/control/cores/collection1
[junit4] 2> 979444 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 979445 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 979445 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 979445 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 979445 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@577ba4ca{/,null,AVAILABLE}
[junit4] 2> 979446 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@71a48869{HTTP/1.1,[http/1.1]}{127.0.0.1:40871}
[junit4] 2> 979446 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.Server Started @981126ms
[junit4] 2> 979446 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=40871, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/control/cores}
[junit4] 2> 979446 ERROR (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 979446 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.1
[junit4] 2> 979446 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 979446 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 979446 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-02T21:35:52.690831Z
[junit4] 2> 979447 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/control/solr.xml
[junit4] 2> 979448 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 979448 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 979448 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 979483 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979494 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979494 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979496 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/control/cores
[junit4] 2> 979496 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 979496 INFO (coreLoadExecutor-4483-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 979496 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 979509 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.1
[junit4] 2> 979521 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 979564 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 979569 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 979569 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979569 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 979569 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/control/cores/collection1/data/]
[junit4] 2> 979570 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=17.2333984375, floorSegmentMB=1.1826171875, forceMergeDeletesPctAllowed=11.246761430356926, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7326376713777923
[junit4] 2> 979605 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 979605 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 979605 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 979606 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 979606 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 979606 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@9379db7[collection1] main]
[junit4] 2> 979607 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 979624 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 979713 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 979713 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 979713 INFO (coreLoadExecutor-4483-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599389777743839232
[junit4] 2> 979713 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 979713 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 979713 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 979713 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 979713 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 979714 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 979714 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 979714 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 979714 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@9379db7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 979799 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/shard0/cores/collection1
[junit4] 2> 979800 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 979800 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 979800 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 979800 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f7763e6{/,null,AVAILABLE}
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7b1e922{HTTP/1.1,[http/1.1]}{127.0.0.1:43141}
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.Server Started @981481ms
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=43141, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/shard0/cores}
[junit4] 2> 979801 ERROR (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.1
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-02T21:35:53.045741Z
[junit4] 2> 979801 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/shard0/solr.xml
[junit4] 2> 979803 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 979803 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 979803 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 979821 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979828 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979828 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979829 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/shard0/cores
[junit4] 2> 979829 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 979829 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 979830 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 979852 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.1
[junit4] 2> 979867 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 979941 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 979957 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 979957 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65147439
[junit4] 2> 979957 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 979958 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001/tempDir-001/shard0/cores/collection1/data/]
[junit4] 2> 979959 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=17.2333984375, floorSegmentMB=1.1826171875, forceMergeDeletesPctAllowed=11.246761430356926, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7326376713777923
[junit4] 2> 979990 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 979990 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 979991 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 979991 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 979992 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 979992 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7ca5d68f[collection1] main]
[junit4] 2> 979993 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 980010 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 980134 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 980135 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 980135 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599389778186338304
[junit4] 2> 980135 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 980135 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 980135 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 980135 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 980135 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 980136 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 980136 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 980136 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 980137 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 980137 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7ca5d68f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 980140 INFO (qtp1076348170-17641) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1599389778189484032)} 0 1
[junit4] 2> 980142 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1599389778192629760)} 0 0
[junit4] 2> 980144 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[1 (1599389778194726912)]} 0 1
[junit4] 2> 980145 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[1 (1599389778196824064)]} 0 0
[junit4] 2> 980146 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[2 (1599389778197872640)]} 0 0
[junit4] 2> 980147 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[2 (1599389778198921216)]} 0 0
[junit4] 2> 980147 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[3 (1599389778198921216)]} 0 0
[junit4] 2> 980148 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[3 (1599389778199969792)]} 0 0
[junit4] 2> 980148 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[4 (1599389778199969792)]} 0 0
[junit4] 2> 980149 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[4 (1599389778201018368)]} 0 0
[junit4] 2> 980150 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[5 (1599389778201018368)]} 0 0
[junit4] 2> 980150 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[5 (1599389778202066944)]} 0 0
[junit4] 2> 980151 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[6 (1599389778203115520)]} 0 0
[junit4] 2> 980151 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[6 (1599389778203115520)]} 0 0
[junit4] 2> 980152 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[7 (1599389778203115521)]} 0 0
[junit4] 2> 980152 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[7 (1599389778204164096)]} 0 0
[junit4] 2> 980153 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[8 (1599389778205212672)]} 0 0
[junit4] 2> 980153 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[8 (1599389778205212672)]} 0 0
[junit4] 2> 980154 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[9 (1599389778206261248)]} 0 0
[junit4] 2> 980154 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[9 (1599389778206261248)]} 0 0
[junit4] 2> 980155 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1599389778207309824,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 980155 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7606c91f commitCommandVersion:1599389778207309824
[junit4] 2> 980160 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b76f3b5[collection1] main]
[junit4] 2> 980160 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 980161 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1b76f3b5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.1):C9)))}
[junit4] 2> 980161 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 6
[junit4] 2> 980161 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1599389778213601280,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 980161 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6f6fe502 commitCommandVersion:1599389778213601280
[junit4] 2> 980165 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@364fcf4b[collection1] main]
[junit4] 2> 980166 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 980167 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@364fcf4b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.1):C9)))}
[junit4] 2> 980167 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
[junit4] 2> 980168 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[10 (1599389778219892736)]} 0 1
[junit4] 2> 980169 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[10 (1599389778221989888)]} 0 0
[junit4] 2> 980170 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[11 (1599389778223038464)]} 0 0
[junit4] 2> 980171 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[11 (1599389778223038464)]} 0 0
[junit4] 2> 980171 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[12 (1599389778224087040)]} 0 0
[junit4] 2> 980172 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[12 (1599389778225135616)]} 0 0
[junit4] 2> 980172 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[13 (1599389778225135616)]} 0 0
[junit4] 2> 980173 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[13 (1599389778226184192)]} 0 0
[junit4] 2> 980174 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[1001 (1599389778226184192)]} 0 0
[junit4] 2> 980175 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[1001 (1599389778227232768)]} 0 0
[junit4] 2> 980175 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[14 (1599389778228281344)]} 0 0
[junit4] 2> 980175 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[14 (1599389778228281344)]} 0 0
[junit4] 2> 980176 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[15 (1599389778229329920)]} 0 0
[junit4] 2> 980176 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[15 (1599389778229329920)]} 0 0
[junit4] 2> 980176 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[16 (1599389778229329921)]} 0 0
[junit4] 2> 980177 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[16 (1599389778230378496)]} 0 0
[junit4] 2> 980177 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[17 (1599389778230378496)]} 0 0
[junit4] 2> 980178 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[17 (1599389778231427072)]} 0 0
[junit4] 2> 980179 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[100 (1599389778231427072)]} 0 0
[junit4] 2> 980179 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[100 (1599389778232475648)]} 0 0
[junit4] 2> 980179 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[101 (1599389778232475648)]} 0 0
[junit4] 2> 980180 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[101 (1599389778233524224)]} 0 0
[junit4] 2> 980180 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[102 (1599389778233524224)]} 0 0
[junit4] 2> 980180 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[102 (1599389778233524225)]} 0 0
[junit4] 2> 980181 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[103 (1599389778234572800)]} 0 0
[junit4] 2> 980181 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[103 (1599389778234572800)]} 0 0
[junit4] 2> 980181 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[104 (1599389778234572801)]} 0 0
[junit4] 2> 980182 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[104 (1599389778235621376)]} 0 0
[junit4] 2> 980182 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[105 (1599389778235621376)]} 0 0
[junit4] 2> 980183 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[105 (1599389778236669952)]} 0 0
[junit4] 2> 980183 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[106 (1599389778236669952)]} 0 0
[junit4] 2> 980184 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[106 (1599389778237718528)]} 0 0
[junit4] 2> 980184 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[107 (1599389778237718528)]} 0 0
[junit4] 2> 980184 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[107 (1599389778237718529)]} 0 0
[junit4] 2> 980185 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[108 (1599389778238767104)]} 0 0
[junit4] 2> 980185 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[108 (1599389778238767104)]} 0 0
[junit4] 2> 980186 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[109 (1599389778238767105)]} 0 0
[junit4] 2> 980186 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[109 (1599389778239815680)]} 0 0
[junit4] 2> 980186 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[110 (1599389778239815680)]} 0 0
[junit4] 2> 980187 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[110 (1599389778239815681)]} 0 0
[junit4] 2> 980187 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[111 (1599389778240864256)]} 0 0
[junit4] 2> 980187 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[111 (1599389778240864256)]} 0 0
[junit4] 2> 980188 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[112 (1599389778241912832)]} 0 0
[junit4] 2> 980188 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[112 (1599389778241912832)]} 0 0
[junit4] 2> 980189 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[113 (1599389778242961408)]} 0 0
[junit4] 2> 980189 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[113 (1599389778242961408)]} 0 0
[junit4] 2> 980190 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[114 (1599389778244009984)]} 0 0
[junit4] 2> 980190 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[114 (1599389778244009984)]} 0 0
[junit4] 2> 980190 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[115 (1599389778244009985)]} 0 0
[junit4] 2> 980191 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[115 (1599389778245058560)]} 0 0
[junit4] 2> 980191 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[116 (1599389778245058560)]} 0 0
[junit4] 2> 980192 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[116 (1599389778245058561)]} 0 0
[junit4] 2> 980192 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[117 (1599389778246107136)]} 0 0
[junit4] 2> 980193 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[117 (1599389778246107136)]} 0 0
[junit4] 2> 980193 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[118 (1599389778247155712)]} 0 0
[junit4] 2> 980193 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[118 (1599389778247155712)]} 0 0
[junit4] 2> 980194 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[119 (1599389778248204288)]} 0 0
[junit4] 2> 980194 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[119 (1599389778248204288)]} 0 0
[junit4] 2> 980194 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[120 (1599389778248204289)]} 0 0
[junit4] 2> 980194 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[120 (1599389778248204289)]} 0 0
[junit4] 2> 980195 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[121 (1599389778249252864)]} 0 0
[junit4] 2> 980195 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[121 (1599389778249252864)]} 0 0
[junit4] 2> 980196 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[122 (1599389778249252865)]} 0 0
[junit4] 2> 980196 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[122 (1599389778250301440)]} 0 0
[junit4] 2> 980196 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[123 (1599389778250301440)]} 0 0
[junit4] 2> 980197 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[123 (1599389778251350016)]} 0 0
[junit4] 2> 980197 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[124 (1599389778251350016)]} 0 0
[junit4] 2> 980198 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[124 (1599389778251350017)]} 0 0
[junit4] 2> 980198 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[125 (1599389778252398592)]} 0 0
[junit4] 2> 980199 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[125 (1599389778252398592)]} 0 0
[junit4] 2> 980199 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[126 (1599389778253447168)]} 0 0
[junit4] 2> 980199 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[126 (1599389778253447168)]} 0 0
[junit4] 2> 980200 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[127 (1599389778254495744)]} 0 0
[junit4] 2> 980200 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[127 (1599389778254495744)]} 0 0
[junit4] 2> 980201 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[128 (1599389778255544320)]} 0 0
[junit4] 2> 980201 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[128 (1599389778255544320)]} 0 0
[junit4] 2> 980202 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[129 (1599389778256592896)]} 0 0
[junit4] 2> 980202 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[129 (1599389778256592896)]} 0 0
[junit4] 2> 980203 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[130 (1599389778257641472)]} 0 0
[junit4] 2> 980203 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[130 (1599389778257641472)]} 0 0
[junit4] 2> 980203 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[131 (1599389778257641473)]} 0 0
[junit4] 2> 980204 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[131 (1599389778258690048)]} 0 0
[junit4] 2> 980204 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[132 (1599389778258690048)]} 0 0
[junit4] 2> 980204 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[132 (1599389778258690049)]} 0 0
[junit4] 2> 980205 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[133 (1599389778259738624)]} 0 0
[junit4] 2> 980205 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[133 (1599389778259738624)]} 0 0
[junit4] 2> 980205 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[134 (1599389778259738625)]} 0 0
[junit4] 2> 980206 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[134 (1599389778260787200)]} 0 0
[junit4] 2> 980206 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[135 (1599389778260787200)]} 0 0
[junit4] 2> 980206 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[135 (1599389778260787201)]} 0 0
[junit4] 2> 980207 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[136 (1599389778261835776)]} 0 0
[junit4] 2> 980207 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[136 (1599389778261835776)]} 0 0
[junit4] 2> 980207 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[137 (1599389778261835777)]} 0 0
[junit4] 2> 980208 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[137 (1599389778262884352)]} 0 0
[junit4] 2> 980208 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[138 (1599389778262884352)]} 0 0
[junit4] 2> 980209 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[138 (1599389778262884353)]} 0 0
[junit4] 2> 980209 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[139 (1599389778263932928)]} 0 0
[junit4] 2> 980209 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[139 (1599389778263932928)]} 0 0
[junit4] 2> 980210 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[140 (1599389778264981504)]} 0 0
[junit4] 2> 980210 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[140 (1599389778264981504)]} 0 0
[junit4] 2> 980210 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[141 (1599389778264981505)]} 0 0
[junit4] 2> 980211 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[141 (1599389778266030080)]} 0 0
[junit4] 2> 980211 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[142 (1599389778266030080)]} 0 0
[junit4] 2> 980212 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[142 (1599389778266030081)]} 0 0
[junit4] 2> 980212 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[143 (1599389778267078656)]} 0 0
[junit4] 2> 980212 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[143 (1599389778267078656)]} 0 0
[junit4] 2> 980213 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[144 (1599389778267078657)]} 0 0
[junit4] 2> 980213 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[144 (1599389778268127232)]} 0 0
[junit4] 2> 980213 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[145 (1599389778268127232)]} 0 0
[junit4] 2> 980213 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[145 (1599389778268127233)]} 0 0
[junit4] 2> 980214 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[146 (1599389778269175808)]} 0 0
[junit4] 2> 980214 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[146 (1599389778269175808)]} 0 0
[junit4] 2> 980214 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[147 (1599389778269175809)]} 0 0
[junit4] 2> 980215 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[147 (1599389778269175809)]} 0 0
[junit4] 2> 980215 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[148 (1599389778270224384)]} 0 0
[junit4] 2> 980215 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[148 (1599389778270224384)]} 0 0
[junit4] 2> 980215 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[149 (1599389778270224385)]} 0 0
[junit4] 2> 980216 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{add=[149 (1599389778271272960)]} 0 0
[junit4] 2> 980216 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1599389778271272960,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 980216 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7606c91f commitCommandVersion:1599389778271272960
[junit4] 2> 980220 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6071fdcb[collection1] main]
[junit4] 2> 980220 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 980221 INFO (searcherExecutor-4484-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6071fdcb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.1):C9) Uninverting(_1(7.3.1):C59)))}
[junit4] 2> 980222 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
[junit4] 2> 980222 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1599389778277564416,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 980222 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6f6fe502 commitCommandVersion:1599389778277564416
[junit4] 2> 980226 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a4bd244[collection1] main]
[junit4] 2> 980226 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 980227 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3a4bd244[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.1):C9) Uninverting(_1(7.3.1):C59)))}
[junit4] 2> 980227 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
[junit4] 2> 980228 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.h.RequestHandlerBase Ignoring exception matching parameter cannot be negative
[junit4] 2> 980228 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*&distrib=false&start=-1&wt=javabin&version=2} status=400 QTime=0
[junit4] 2> 980228 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.h.RequestHandlerBase Ignoring exception matching parameter cannot be negative
[junit4] 2> 980229 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*&distrib=false&start=0&rows=-1&wt=javabin&version=2} status=400 QTime=0
[junit4] 2> 980229 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_ti1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980235 INFO (qtp1927884486-17663) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_ti1+desc&shard.url=[ff01::114]:33332/|[ff01::083]:33332/|http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953474&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980236 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953474&ids=111,122,123,14,146,102,15,115,106,142&isShard=true&shard.url=[ff01::114]:33332/|[ff01::083]:33332/|http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980237 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=[ff01::114]:33332/|[ff01::083]:33332/|http://127.0.0.1:43141//collection1&sort=n_ti1+desc&wt=javabin&version=2} hits=68 status=0 QTime=7
[junit4] 2> 980238 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_ti1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980239 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_ti1+asc&shard.url=[ff01::083]:33332/|http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953482&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980240 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953482&ids=143,101,125,126,127,117,139,108,109,120&isShard=true&shard.url=[ff01::083]:33332/|http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980240 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|http://127.0.0.1:43141//collection1&sort=n_ti1+asc&wt=javabin&version=2} hits=68 status=0 QTime=1
[junit4] 2> 980241 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_f1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980242 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_f1+desc&shard.url=http://127.0.0.1:43141//collection1|[ff01::213]:33332/&rows=10&version=2&q=*:*&NOW=1525296953486&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980243 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953486&ids=100,122,136,115,6,17,9,119,109,131&isShard=true&shard.url=http://127.0.0.1:43141//collection1|[ff01::213]:33332/&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980244 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=http://127.0.0.1:43141//collection1|[ff01::213]:33332/&sort=n_f1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
[junit4] 2> 980244 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_f1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980246 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_f1+asc&shard.url=http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953489&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980246 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953489&ids=110,111,1,124,3,125,15,107,108,120&isShard=true&shard.url=http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980247 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=http://127.0.0.1:43141//collection1&sort=n_f1+asc&wt=javabin&version=2} hits=68 status=0 QTime=1
[junit4] 2> 980247 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_tf1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980250 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tf1+desc&shard.url=[ff01::213]:33332/|[ff01::083]:33332/|[ff01::114]:33332/|http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953492&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980251 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953492&ids=145,103,4,147,5,116,1001,7,120,131&isShard=true&shard.url=[ff01::213]:33332/|[ff01::083]:33332/|[ff01::114]:33332/|http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980252 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=[ff01::213]:33332/|[ff01::083]:33332/|[ff01::114]:33332/|http://127.0.0.1:43141//collection1&sort=n_tf1+desc&wt=javabin&version=2} hits=68 status=0 QTime=3
[junit4] 2> 980252 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_tf1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980254 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tf1+asc&shard.url=http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953497&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980255 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953497&ids=110,133,134,124,3,118,8,107,141,10&isShard=true&shard.url=http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980255 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=http://127.0.0.1:43141//collection1&sort=n_tf1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
[junit4] 2> 980256 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_d1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980257 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_d1+desc&shard.url=[ff01::083]:33332/|http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953501&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980258 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953501&ids=11,144,134,145,113,15,126,149,118,119&isShard=true&shard.url=[ff01::083]:33332/|http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980259 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|http://127.0.0.1:43141//collection1&sort=n_d1+desc&wt=javabin&version=2} hits=68 status=0 QTime=1
[junit4] 2> 980260 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_d1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980261 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_d1+asc&shard.url=http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953505&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980262 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953505&ids=122,2,112,146,114,4,139,140,141,131&isShard=true&shard.url=http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980263 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=http://127.0.0.1:43141//collection1&sort=n_d1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
[junit4] 2> 980263 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_td1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980265 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_td1+desc&shard.url=http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953508&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980265 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953508&ids=11,122,144,134,103,114,148,16,9,140&isShard=true&shard.url=http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980266 INFO (qtp1927884486-17664) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=http://127.0.0.1:43141//collection1&sort=n_td1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
[junit4] 2> 980267 INFO (qtp1076348170-17645) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_td1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980268 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_td1+asc&shard.url=[ff01::213]:33332/|http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953512&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980269 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953512&ids=132,12,146,102,3,5,126,107,108,130&isShard=true&shard.url=[ff01::213]:33332/|http://127.0.0.1:43141//collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 980270 INFO (qtp1927884486-17662) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&shards=[ff01::213]:33332/|http://127.0.0.1:43141//collection1&sort=n_td1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
[junit4] 2> 980271 INFO (qtp1076348170-17647) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&sort=n_l1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
[junit4] 2> 980272 INFO (qtp1927884486-17658) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_l1+desc&shard.url=[ff01::114]:33332/|http://127.0.0.1:43141//collection1&rows=10&version=2&q=*:*&NOW=1525296953515&isShard=true&wt=javabin} hits=68 status=0 QTime=0
[junit4] 2> 980273 INFO (qtp1927884486-17659) [ x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1525296953515&ids=11,112,135,16,1
[...truncated too long message...]
nit4] 2> 97775 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 97775 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@236e598d{HTTP/1.1,[http/1.1]}{127.0.0.1:42583}
[junit4] 2> 97775 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1875843918
[junit4] 2> 97775 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 97775 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 97775 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 97776 INFO (coreCloseExecutor-260-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@13264fb0
[junit4] 2> 97776 INFO (coreCloseExecutor-260-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=321277872
[junit4] 2> 97778 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@430ad259{/,null,UNAVAILABLE}
[junit4] 2> 97778 INFO (TEST-TestDistributedSearch.test-seed#[35FADDAD4CD3D3AD]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDistributedSearch -Dtests.method=test -Dtests.seed=35FADDAD4CD3D3AD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=zgh -Dtests.timezone=MST -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 29.0s J2 | TestDistributedSearch.test <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:42583//collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([35FADDAD4CD3D3AD:BDAEE277E22FBE55]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
[junit4] > at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
[junit4] > at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:542)
[junit4] > at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:1034)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1019)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:841)
[junit4] > Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:42583 failed to respond
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] > at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] > at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] > at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] > at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] > at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] > at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] > at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] > ... 48 more
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.3-Linux/solr/build/solr-core/test/J2/temp/solr.TestDistributedSearch_35FADDAD4CD3D3AD-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {severity=PostingsFormat(name=Memory), foo_sev_enum=PostingsFormat(name=LuceneVarGapFixedInterval), SubjectTerms_mfacet=PostingsFormat(name=LuceneFixedGap), multiDefault=PostingsFormat(name=LuceneVarGapDocFreqInterval), rnd_b=PostingsFormat(name=LuceneVarGapFixedInterval), a_s=PostingsFormat(name=Memory), oddField_s=PostingsFormat(name=Memory), lowerfilt1and2=PostingsFormat(name=LuceneVarGapDocFreqInterval), a_t=PostingsFormat(name=LuceneFixedGap), foo_b=PostingsFormat(name=Memory), lowerfilt=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=PostingsFormat(name=LuceneVarGapFixedInterval), text=PostingsFormat(name=Memory)}, docValues:{other_tl1=DocValuesFormat(name=Direct), range_facet_l_dv=DocValuesFormat(name=Lucene70), n_l1=DocValuesFormat(name=Direct), a_n_tdt=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Direct), n_td1=DocValuesFormat(name=Asserting), n_d1=DocValuesFormat(name=Direct), range_facet_l=DocValuesFormat(name=Direct), n_f1=DocValuesFormat(name=Asserting), n_tl1=DocValuesFormat(name=Asserting), n_tf1=DocValuesFormat(name=Direct), intDvoDefault=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Direct), severity=DocValuesFormat(name=Memory), foo_sev_enum=DocValuesFormat(name=Lucene70), n_dt1=DocValuesFormat(name=Asserting), b_n_tdt=DocValuesFormat(name=Direct), n_ti1=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Direct), n_tdt1=DocValuesFormat(name=Direct), id_i1=DocValuesFormat(name=Asserting), foo_d=DocValuesFormat(name=Lucene70), range_facet_i_dv=DocValuesFormat(name=Direct), foo_f=DocValuesFormat(name=Memory), a_i_ni_p=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=911, maxMBSortInHeap=7.651461249239784, sim=RandomSimilarity(queryNorm=true): {}, locale=zgh, timezone=MST
[junit4] 2> NOTE: Linux 4.13.0-39-generic amd64/Oracle Corporation 11-ea (64-bit)/cpus=8,threads=1,free=263414552,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestDistributedSearch, TestDistributedSearch]
[junit4] Completed [5/5 (1!)] on J2 in 29.02s, 1 test, 1 error <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.3-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.3-Linux/lucene/common-build.xml:1091: There were test failures: 5 suites, 5 tests, 1 error [seed: 35FADDAD4CD3D3AD]
Total time: 1 minute 43 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 1/5 failed: org.apache.solr.TestDistributedSearch
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=7b74345edb3969ffc523284b116a0437a275102a, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.3-Linux
[WARNINGS] Computing warning deltas based on reference build #162
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2