You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/01/06 22:10:59 UTC
[JENKINS] Lucene-Solr-Tests-6.x - Build # 654 - Still Unstable
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/654/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPISolrJTest.testSplitShard
Error Message:
Error from server at https://127.0.0.1:57624/solr: Could not fully remove collection: solrj_test_splitshard
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:57624/solr: Could not fully remove collection: solrj_test_splitshard
at __randomizedtesting.SeedInfo.seed([8E7578B987654669:557FD5D599907AD6]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1344)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1095)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1037)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
at org.apache.solr.cloud.CollectionsAPISolrJTest.testSplitShard(CollectionsAPISolrJTest.java:143)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12205 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPISolrJTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/init-core-data-001
[junit4] 2> 1153578 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1153579 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001
[junit4] 2> 1153579 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1153581 INFO (Thread-3893) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1153582 INFO (Thread-3893) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1153682 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:53007
[junit4] 2> 1153701 INFO (jetty-launcher-2263-thread-1) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1153703 INFO (jetty-launcher-2263-thread-2) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1153709 INFO (jetty-launcher-2263-thread-3) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1153759 INFO (jetty-launcher-2263-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@20c6af4f{/solr,null,AVAILABLE}
[junit4] 2> 1153761 INFO (jetty-launcher-2263-thread-4) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1153766 INFO (jetty-launcher-2263-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@21e37090{/solr,null,AVAILABLE}
[junit4] 2> 1153777 INFO (jetty-launcher-2263-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5ea7a5dc{SSL,[ssl, http/1.1]}{127.0.0.1:46810}
[junit4] 2> 1153777 INFO (jetty-launcher-2263-thread-3) [ ] o.e.j.s.Server Started @1157944ms
[junit4] 2> 1153777 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46810}
[junit4] 2> 1153777 ERROR (jetty-launcher-2263-thread-3) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1153777 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.0
[junit4] 2> 1153777 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1153777 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1153777 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-06T21:41:12.390Z
[junit4] 2> 1153792 INFO (jetty-launcher-2263-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@524966b3{SSL,[ssl, http/1.1]}{127.0.0.1:40694}
[junit4] 2> 1153792 INFO (jetty-launcher-2263-thread-2) [ ] o.e.j.s.Server Started @1157959ms
[junit4] 2> 1153793 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40694}
[junit4] 2> 1153793 ERROR (jetty-launcher-2263-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1153793 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.0
[junit4] 2> 1153793 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1153793 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1153793 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-06T21:41:12.406Z
[junit4] 2> 1153796 INFO (jetty-launcher-2263-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13b473d8{/solr,null,AVAILABLE}
[junit4] 2> 1153797 INFO (jetty-launcher-2263-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3b7295cf{SSL,[ssl, http/1.1]}{127.0.0.1:57624}
[junit4] 2> 1153797 INFO (jetty-launcher-2263-thread-4) [ ] o.e.j.s.Server Started @1157964ms
[junit4] 2> 1153797 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=57624}
[junit4] 2> 1153797 ERROR (jetty-launcher-2263-thread-4) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1153797 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.0
[junit4] 2> 1153797 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1153798 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1153798 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-06T21:41:12.411Z
[junit4] 2> 1153810 INFO (jetty-launcher-2263-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@23fda024{/solr,null,AVAILABLE}
[junit4] 2> 1153812 INFO (jetty-launcher-2263-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4d6a3f45{SSL,[ssl, http/1.1]}{127.0.0.1:40572}
[junit4] 2> 1153812 INFO (jetty-launcher-2263-thread-1) [ ] o.e.j.s.Server Started @1157978ms
[junit4] 2> 1153812 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40572}
[junit4] 2> 1153812 ERROR (jetty-launcher-2263-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1153812 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.0
[junit4] 2> 1153812 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1153812 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1153812 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-06T21:41:12.425Z
[junit4] 2> 1153828 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1153843 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1153844 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1153850 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1153850 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1153854 INFO (jetty-launcher-2263-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53007/solr
[junit4] 2> 1153856 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1153856 INFO (jetty-launcher-2263-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53007/solr
[junit4] 2> 1153858 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1153859 INFO (jetty-launcher-2263-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53007/solr
[junit4] 2> 1153860 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1153861 INFO (jetty-launcher-2263-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53007/solr
[junit4] 2> 1153872 INFO (jetty-launcher-2263-thread-4) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57624_solr
[junit4] 2> 1153872 INFO (jetty-launcher-2263-thread-4) [n:127.0.0.1:57624_solr ] o.a.s.c.Overseer Overseer (id=97238310728171529-127.0.0.1:57624_solr-n_0000000000) starting
[junit4] 2> 1153879 INFO (jetty-launcher-2263-thread-3) [n:127.0.0.1:46810_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46810_solr
[junit4] 2> 1153890 INFO (zkCallback-2278-thread-1-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1153891 INFO (jetty-launcher-2263-thread-4) [n:127.0.0.1:57624_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57624_solr
[junit4] 2> 1153902 INFO (zkCallback-2278-thread-1-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1153924 INFO (jetty-launcher-2263-thread-2) [n:127.0.0.1:40694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1153926 INFO (jetty-launcher-2263-thread-2) [n:127.0.0.1:40694_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40694_solr
[junit4] 2> 1153927 INFO (zkCallback-2282-thread-1-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1153934 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:40694_solr) [n:127.0.0.1:40694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1153950 INFO (zkCallback-2278-thread-2-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1153951 INFO (jetty-launcher-2263-thread-1) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1153954 INFO (jetty-launcher-2263-thread-1) [n:127.0.0.1:40572_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40572_solr
[junit4] 2> 1153955 INFO (zkCallback-2282-thread-1-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1153955 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:40694_solr) [n:127.0.0.1:40694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1153955 INFO (zkCallback-2278-thread-1-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1153956 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1153977 INFO (jetty-launcher-2263-thread-2) [n:127.0.0.1:40694_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node2/.
[junit4] 2> 1153978 INFO (jetty-launcher-2263-thread-4) [n:127.0.0.1:57624_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node4/.
[junit4] 2> 1153994 INFO (jetty-launcher-2263-thread-1) [n:127.0.0.1:40572_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node1/.
[junit4] 2> 1153997 INFO (jetty-launcher-2263-thread-3) [n:127.0.0.1:46810_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node3/.
[junit4] 2> 1156002 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1156003 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53007/solr ready
[junit4] 2> 1156022 INFO (TEST-CollectionsAPISolrJTest.testOverseerStatus-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOverseerStatus
[junit4] 2> 1156090 INFO (qtp1108400643-12622) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156116 INFO (qtp1108400643-12622) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=26
[junit4] 2> 1156117 INFO (TEST-CollectionsAPISolrJTest.testOverseerStatus-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatus
[junit4] 2> 1156140 INFO (TEST-CollectionsAPISolrJTest.testClusterProp-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testClusterProp
[junit4] 2> 1156143 INFO (qtp1108400643-12623) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156144 INFO (qtp1108400643-12623) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1156146 INFO (qtp1108400643-12624) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156147 INFO (qtp1108400643-12624) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1156148 INFO (TEST-CollectionsAPISolrJTest.testClusterProp-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testClusterProp
[junit4] 2> 1156168 INFO (TEST-CollectionsAPISolrJTest.testAddAndRemoveRole-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAddAndRemoveRole
[junit4] 2> 1156171 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addrole with params node=127.0.0.1:40572_solr&role=overseer&action=ADDROLE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156173 INFO (OverseerThreadFactory-6005-thread-2-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerRoleCmd Overseer role added to 127.0.0.1:40572_solr
[junit4] 2> 1156173 INFO (OverseerCollectionConfigSetProcessor-97238310728171529-127.0.0.1:57624_solr-n_0000000000) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1156181 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40572_solr&role=overseer&action=ADDROLE&wt=javabin&version=2} status=0 QTime=9
[junit4] 2> 1156183 INFO (qtp1108400643-12620) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156185 INFO (qtp1108400643-12620) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1156187 INFO (Thread-3930) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerNodePrioritizer prioritizing overseer nodes at 97238310728171529-127.0.0.1:57624_solr-n_0000000000 overseer designates are [127.0.0.1:40572_solr]
[junit4] 2> 1156187 INFO (qtp1108400643-12621) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :removerole with params node=127.0.0.1:40572_solr&role=overseer&action=REMOVEROLE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156188 INFO (Thread-3930) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerNodePrioritizer sorted nodes [97238310728171529-127.0.0.1:57624_solr-n_0000000000, 97238310728171530-127.0.0.1:46810_solr-n_0000000001, 97238310728171532-127.0.0.1:40694_solr-n_0000000002, 97238310728171531-127.0.0.1:40572_solr-n_0000000003]
[junit4] 2> 1156188 INFO (Thread-3930) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerNodePrioritizer asking node 97238310728171531-127.0.0.1:40572_solr-n_0000000003 to come join election at head
[junit4] 2> 1156199 INFO (OverseerCollectionConfigSetProcessor-97238310728171529-127.0.0.1:57624_solr-n_0000000000) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1156200 INFO (OverseerThreadFactory-6005-thread-3-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerRoleCmd Overseer role removed from 127.0.0.1:40572_solr
[junit4] 2> 1156229 INFO (qtp1108400643-12621) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40572_solr&role=overseer&action=REMOVEROLE&wt=javabin&version=2} status=0 QTime=42
[junit4] 2> 1156231 INFO (qtp1108400643-12622) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156235 INFO (qtp1108400643-12622) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 1156235 INFO (TEST-CollectionsAPISolrJTest.testAddAndRemoveRole-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testAddAndRemoveRole
[junit4] 2> 1156256 INFO (TEST-CollectionsAPISolrJTest.testSplitShard-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSplitShard
[junit4] 2> 1156258 INFO (qtp1108400643-12623) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=solrj_test_splitshard&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1156260 INFO (OverseerCollectionConfigSetProcessor-97238310728171529-127.0.0.1:57624_solr-n_0000000000) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1156260 INFO (OverseerThreadFactory-6005-thread-4-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.CreateCollectionCmd Create collection solrj_test_splitshard
[junit4] 2> 1156264 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={op=rejoinAtHead&qt=/admin/cores&action=OVERSEEROP&electionNode=97238310728171531-127.0.0.1:40572_solr-n_0000000003&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1156264 INFO (Thread-3930) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerNodePrioritizer asking the old first in line 97238310728171530-127.0.0.1:46810_solr-n_0000000001 to rejoin election
[junit4] 2> 1156328 INFO (qtp669334722-12603) [n:127.0.0.1:46810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={op=rejoin&qt=/admin/cores&action=OVERSEEROP&electionNode=97238310728171530-127.0.0.1:46810_solr-n_0000000001&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1156331 INFO (OverseerStateUpdate-97238310728171529-127.0.0.1:57624_solr-n_0000000000) [n:127.0.0.1:57624_solr ] o.a.s.c.Overseer Quit command received {
[junit4] 2> "operation":"quit",
[junit4] 2> "id":"97238310728171529-127.0.0.1:57624_solr-n_0000000000"} 127.0.0.1:57624_solr
[junit4] 2> 1156370 INFO (qtp852841910-12613) [n:127.0.0.1:40572_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_test_splitshard_shard1_replica1&action=CREATE&numShards=2&collection=solrj_test_splitshard&shard=shard1&wt=javabin&version=2
[junit4] 2> 1156428 INFO (qtp357673595-12593) [n:127.0.0.1:40694_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_test_splitshard_shard2_replica1&action=CREATE&numShards=2&collection=solrj_test_splitshard&shard=shard2&wt=javabin&version=2
[junit4] 2> 1246456 ERROR (OverseerThreadFactory-6005-thread-4-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:40572/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:40572/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:163)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] 2> at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] 2> at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:170)
[junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] 2> at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
[junit4] 2> at sun.security.ssl.InputRecord.read(InputRecord.java:503)
[junit4] 2> at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
[junit4] 2> at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
[junit4] 2> at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
[junit4] 2> at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] 2> at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] 2> at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] 2> at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] 2> at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:57)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
[junit4] 2> ... 12 more
[junit4] 2> 1246515 ERROR (OverseerThreadFactory-6005-thread-4-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:40694/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:40694/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:163)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] 2> at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] 2> at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:170)
[junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] 2> at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
[junit4] 2> at sun.security.ssl.InputRecord.read(InputRecord.java:503)
[junit4] 2> at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
[junit4] 2> at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
[junit4] 2> at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
[junit4] 2> at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] 2> at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] 2> at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] 2> at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] 2> at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:57)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
[junit4] 2> ... 12 more
[junit4] 2> 1246517 ERROR (OverseerThreadFactory-6005-thread-4-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [solrj_test_splitshard].
[junit4] 2> 1246517 INFO (OverseerThreadFactory-6005-thread-4-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 1276535 ERROR (OverseerThreadFactory-6005-thread-4-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: solrj_test_splitshard operation: create failed:org.apache.solr.common.SolrException: Could not fully remove collection: solrj_test_splitshard
[junit4] 2> at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:99)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.cleanupCollection(OverseerCollectionMessageHandler.java:694)
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:276)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1276550 INFO (zkCallback-2283-thread-2-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/solrj_test_splitshard/state.json] for collection [solrj_test_splitshard] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1276629 INFO (zkCallback-2285-thread-2-processing-n:127.0.0.1:40694_solr) [n:127.0.0.1:40694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/solrj_test_splitshard/state.json] for collection [solrj_test_splitshard] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1276631 INFO (qtp1108400643-12623) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=solrj_test_splitshard&action=CREATE&numShards=2&wt=javabin&version=2} status=500 QTime=120373
[junit4] 2> 1276631 ERROR (qtp1108400643-12623) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Could not fully remove collection: solrj_test_splitshard
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:287)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:218)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:664)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:445)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:296)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:110)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1276632 INFO (TEST-CollectionsAPISolrJTest.testSplitShard-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSplitShard
[junit4] 2> 1276632 INFO (OverseerStateUpdate-97238310728171529-127.0.0.1:57624_solr-n_0000000000) [n:127.0.0.1:57624_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:57624_solr
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPISolrJTest -Dtests.method=testSplitShard -Dtests.seed=8E7578B987654669 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=pt-BR -Dtests.timezone=Etc/GMT-2 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 120s J2 | CollectionsAPISolrJTest.testSplitShard <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:57624/solr: Could not fully remove collection: solrj_test_splitshard
[junit4] > at __randomizedtesting.SeedInfo.seed([8E7578B987654669:557FD5D599907AD6]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1344)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1095)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1037)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
[junit4] > at org.apache.solr.cloud.CollectionsAPISolrJTest.testSplitShard(CollectionsAPISolrJTest.java:143)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1276691 WARN (OverseerExitThread) [n:127.0.0.1:57624_solr ] o.a.s.c.Overseer I'm exiting, but I'm still the leader
[junit4] 2> 1276698 INFO (OverseerExitThread) [n:127.0.0.1:57624_solr ] o.a.s.c.Overseer Overseer (id=97238310728171529-127.0.0.1:57624_solr-n_0000000000) closing
[junit4] 2> 1276700 INFO (zkCallback-2282-thread-2-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46810_solr
[junit4] 2> 1276704 INFO (zkCallback-2282-thread-2-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.Overseer Overseer (id=97238310728171530-127.0.0.1:46810_solr-n_0000000001) starting
[junit4] 2> 1276707 INFO (TEST-CollectionsAPISolrJTest.testAddAndDeleteReplica-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAddAndDeleteReplica
[junit4] 2> 1276708 INFO (qtp1108400643-12624) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=solrj_replicatests&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1276750 INFO (OverseerThreadFactory-6015-thread-1-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.CreateCollectionCmd Create collection solrj_replicatests
[junit4] 2> 1276964 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_replicatests_shard1_replica1&action=CREATE&numShards=1&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2
[junit4] 2> 1276974 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_replicatests_shard1_replica2&action=CREATE&numShards=1&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2
[junit4] 2> 1277077 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1277078 INFO (zkCallback-2282-thread-3-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1277980 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
[junit4] 2> 1277986 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
[junit4] 2> 1277992 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.s.IndexSchema [solrj_replicatests_shard1_replica2] Schema name=minimal
[junit4] 2> 1277994 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1278003 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.s.IndexSchema [solrj_replicatests_shard1_replica1] Schema name=minimal
[junit4] 2> 1278005 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1278005 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.c.CoreContainer Creating SolrCore 'solrj_replicatests_shard1_replica2' using configuration from collection solrj_replicatests
[junit4] 2> 1278006 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'solrj_replicatests_shard1_replica1' using configuration from collection solrj_replicatests
[junit4] 2> 1278006 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.SolrCore [[solrj_replicatests_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node3/solrj_replicatests_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node3/./solrj_replicatests_shard1_replica1/data/]
[junit4] 2> 1278007 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.c.SolrCore [[solrj_replicatests_shard1_replica2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node1/solrj_replicatests_shard1_replica2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node1/./solrj_replicatests_shard1_replica2/data/]
[junit4] 2> 1278032 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1278032 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1278033 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1278033 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1278034 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@41be4cd9[solrj_replicatests_shard1_replica1] main]
[junit4] 2> 1278034 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1278034 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1278035 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1278035 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555813102149173248
[junit4] 2> 1278039 INFO (searcherExecutor-6017-thread-1-processing-n:127.0.0.1:46810_solr x:solrj_replicatests_shard1_replica1 s:shard1 c:solrj_replicatests) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.SolrCore [solrj_replicatests_shard1_replica1] Registered new searcher Searcher@41be4cd9[solrj_replicatests_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1278040 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 1278062 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1278062 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1278063 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1278063 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1278064 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@79bebbd8[solrj_replicatests_shard1_replica2] main]
[junit4] 2> 1278064 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1278064 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1278064 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1278065 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555813102180630528
[junit4] 2> 1278068 INFO (searcherExecutor-6016-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica2 s:shard1 c:solrj_replicatests) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.c.SolrCore [solrj_replicatests_shard1_replica2] Registered new searcher Searcher@79bebbd8[solrj_replicatests_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1278141 INFO (zkCallback-2282-thread-2-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1278142 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1278541 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1278541 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1278541 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:46810/solr/solrj_replicatests_shard1_replica1/
[junit4] 2> 1278541 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.u.PeerSync PeerSync: core=solrj_replicatests_shard1_replica1 url=https://127.0.0.1:46810/solr START replicas=[https://127.0.0.1:40572/solr/solrj_replicatests_shard1_replica2/] nUpdates=100
[junit4] 2> 1278541 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.u.PeerSync PeerSync: core=solrj_replicatests_shard1_replica1 url=https://127.0.0.1:46810/solr DONE. We have no versions. sync failed.
[junit4] 2> 1278546 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node2 x:solrj_replicatests_shard1_replica2] o.a.s.c.S.Request [solrj_replicatests_shard1_replica2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1278548 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1278548 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1278551 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:46810/solr/solrj_replicatests_shard1_replica1/ shard1
[junit4] 2> 1278653 INFO (zkCallback-2282-thread-5-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1278653 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1278702 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1278704 INFO (qtp669334722-12604) [n:127.0.0.1:46810_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_replicatests_shard1_replica1&action=CREATE&numShards=1&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2} status=0 QTime=1739
[junit4] 2> 1278805 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1278806 INFO (zkCallback-2282-thread-4-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1279072 INFO (qtp852841910-12612) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_replicatests_shard1_replica2&action=CREATE&numShards=1&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2} status=0 QTime=2097
[junit4] 2> 1279076 INFO (qtp1108400643-12624) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1279182 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1279182 INFO (zkCallback-2282-thread-4-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1280077 INFO (qtp1108400643-12624) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=solrj_replicatests&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3368
[junit4] 2> 1280082 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40572_solr&action=ADDREPLICA&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1280084 INFO (OverseerThreadFactory-6015-thread-2-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.AddReplicaCmd addReplica() : {
[junit4] 2> "collection":"solrj_replicatests",
[junit4] 2> "node":"127.0.0.1:40572_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "operation":"addreplica"}
[junit4] 2> 1280084 INFO (OverseerCollectionConfigSetProcessor-97238310728171530-127.0.0.1:46810_solr-n_0000000001) [n:127.0.0.1:46810_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1280084 INFO (OverseerThreadFactory-6015-thread-2-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40572_solr for creating new replica
[junit4] 2> 1280087 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&name=solrj_replicatests_shard1_replica3&action=CREATE&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2
[junit4] 2> 1280190 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1280191 INFO (zkCallback-2282-thread-3-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1281093 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
[junit4] 2> 1281099 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.s.IndexSchema [solrj_replicatests_shard1_replica3] Schema name=minimal
[junit4] 2> 1281101 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1281101 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.c.CoreContainer Creating SolrCore 'solrj_replicatests_shard1_replica3' using configuration from collection solrj_replicatests
[junit4] 2> 1281102 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.c.SolrCore [[solrj_replicatests_shard1_replica3] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node1/solrj_replicatests_shard1_replica3], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node1/./solrj_replicatests_shard1_replica3/data/]
[junit4] 2> 1281114 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1281114 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1281114 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1281114 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1281115 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.s.SolrIndexSearcher Opening [Searcher@4552648a[solrj_replicatests_shard1_replica3] main]
[junit4] 2> 1281116 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1281116 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1281116 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1281116 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555813105379835904
[junit4] 2> 1281118 INFO (searcherExecutor-6026-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.c.SolrCore [solrj_replicatests_shard1_replica3] Registered new searcher Searcher@4552648a[solrj_replicatests_shard1_replica3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1281119 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.c.ZkController Core needs to recover:solrj_replicatests_shard1_replica3
[junit4] 2> 1281122 INFO (updateExecutor-2275-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1281122 INFO (qtp852841910-12597) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 x:solrj_replicatests_shard1_replica3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&name=solrj_replicatests_shard1_replica3&action=CREATE&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2} status=0 QTime=1035
[junit4] 2> 1281123 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1281123 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1281124 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[solrj_replicatests_shard1_replica3]
[junit4] 2> 1281124 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1281124 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy Publishing state of core [solrj_replicatests_shard1_replica3] as recovering, leader is [https://127.0.0.1:46810/solr/solrj_replicatests_shard1_replica1/] and I am [https://127.0.0.1:40572/solr/solrj_replicatests_shard1_replica3/]
[junit4] 2> 1281124 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40572_solr&action=ADDREPLICA&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2} status=0 QTime=1042
[junit4] 2> 1281127 INFO (qtp1108400643-12620) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletereplica with params replica=core_node3&action=DELETEREPLICA&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1281129 INFO (OverseerCollectionConfigSetProcessor-97238310728171530-127.0.0.1:46810_solr-n_0000000001) [n:127.0.0.1:46810_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000010 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1281130 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.solrj_replicatests_shard1_replica3
[junit4] 2> 1281130 WARN (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.RecoveryStrategy Stopping recovery for core=[solrj_replicatests_shard1_replica3] coreNodeName=[core_node3]
[junit4] 2> 1281130 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281131 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:46810/solr]; [WaitForState: action=PREPRECOVERY&core=solrj_replicatests_shard1_replica1&nodeName=127.0.0.1:40572_solr&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1281133 INFO (qtp669334722-12605) [n:127.0.0.1:46810_solr ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 1281133 INFO (qtp669334722-12605) [n:127.0.0.1:46810_solr ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see solrj_replicatests_shard1_replica1 (shard1 of solrj_replicatests) have state: recovering
[junit4] 2> 1281133 INFO (qtp669334722-12605) [n:127.0.0.1:46810_solr ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=solrj_replicatests, shard=shard1, thisCore=solrj_replicatests_shard1_replica1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:40572_solr, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"solrj_replicatests_shard1_replica3","base_url":"https://127.0.0.1:40572/solr","node_name":"127.0.0.1:40572_solr","state":"down"}
[junit4] 2> 1281228 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1281229 INFO (zkCallback-2282-thread-4-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1281230 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281330 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281431 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281531 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281631 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281731 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281831 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1281932 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1282032 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1282132 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.SolrCore Core solrj_replicatests_shard1_replica3 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 1282134 INFO (qtp669334722-12605) [n:127.0.0.1:46810_solr ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=solrj_replicatests, shard=shard1, thisCore=solrj_replicatests_shard1_replica1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:40572_solr, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"solrj_replicatests_shard1_replica3","base_url":"https://127.0.0.1:40572/solr","node_name":"127.0.0.1:40572_solr","state":"recovering"}
[junit4] 2> 1282134 INFO (qtp669334722-12605) [n:127.0.0.1:46810_solr ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 1282134 INFO (qtp669334722-12605) [n:127.0.0.1:46810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:40572_solr&onlyIfLeaderActive=true&core=solrj_replicatests_shard1_replica1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001
[junit4] 2> 1282135 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy RecoveryStrategy has been closed
[junit4] 2> 1282135 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy Replay not started, or was not successful... still buffering updates.
[junit4] 2> 1282135 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[false]
[junit4] 2> 1282135 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.SolrCore [solrj_replicatests_shard1_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@30e88351
[junit4] 2> 1282136 WARN (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.c.RecoveryStrategy Stopping recovery for core=[solrj_replicatests_shard1_replica3] coreNodeName=[core_node3]
[junit4] 2> 1282136 INFO (recoveryExecutor-2276-thread-1-processing-n:127.0.0.1:40572_solr x:solrj_replicatests_shard1_replica3 s:shard1 c:solrj_replicatests r:core_node3) [n:127.0.0.1:40572_solr c:solrj_replicatests s:shard1 r:core_node3 x:solrj_replicatests_shard1_replica3] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.solrj_replicatests.shard1.replica3
[junit4] 2> 1282233 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 1282234 INFO (qtp852841910-12608) [n:127.0.0.1:40572_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=solrj_replicatests_shard1_replica3&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} status=0 QTime=1103
[junit4] 2> 1282336 INFO (zkCallback-2283-thread-3-processing-n:127.0.0.1:40572_solr) [n:127.0.0.1:40572_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1282336 INFO (zkCallback-2282-thread-4-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_replicatests/state.json] for collection [solrj_replicatests] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1282436 INFO (qtp1108400643-12620) [n:127.0.0.1:57624_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replica=core_node3&action=DELETEREPLICA&collection=solrj_replicatests&shard=shard1&wt=javabin&version=2} status=0 QTime=1309
[junit4] 2> 1282437 INFO (TEST-CollectionsAPISolrJTest.testAddAndDeleteReplica-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testAddAndDeleteReplica
[junit4] 2> 1282464 INFO (TEST-CollectionsAPISolrJTest.testCreateCollectionWithPropertyParam-seed#[8E7578B987654669]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateCollectionWithPropertyParam
[junit4] 2> 1282466 INFO (qtp1108400643-12621) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&property.ulogDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/testPropertyParamsForCreate-001/ulogDir-subk&property.dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/testPropertyParamsForCreate-001/dataDir-le&collection.configName=conf&name=solrj_test_core_props&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1282467 INFO (OverseerCollectionConfigSetProcessor-97238310728171530-127.0.0.1:46810_solr-n_0000000001) [n:127.0.0.1:46810_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000012 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1282467 INFO (OverseerThreadFactory-6015-thread-4-processing-n:127.0.0.1:46810_solr) [n:127.0.0.1:46810_solr ] o.a.s.c.CreateCollectionCmd Create collection solrj_test_core_props
[junit4] 2> 1282680 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr ] o.a.s.h.a.CoreAdminOperation core create command property.ulogDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/testPropertyParamsForCreate-001/ulogDir-subk&qt=/admin/cores&property.dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/testPropertyParamsForCreate-001/dataDir-le&collection.configName=conf&newCollection=true&name=solrj_test_core_props_shard1_replica1&action=CREATE&numShards=1&collection=solrj_test_core_props&shard=shard1&wt=javabin&version=2
[junit4] 2> 1282783 INFO (zkCallback-2278-thread-4-processing-n:127.0.0.1:57624_solr) [n:127.0.0.1:57624_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/solrj_test_core_props/state.json] for collection [solrj_test_core_props] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1283699 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
[junit4] 2> 1283705 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.s.IndexSchema [solrj_test_core_props_shard1_replica1] Schema name=minimal
[junit4] 2> 1283720 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1283721 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'solrj_test_core_props_shard1_replica1' using configuration from collection solrj_test_core_props
[junit4] 2> 1283722 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.c.SolrCore [[solrj_test_core_props_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/tempDir-001/node4/solrj_test_core_props_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001/testPropertyParamsForCreate-001/dataDir-le/]
[junit4] 2> 1283734 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1283735 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1283735 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1283735 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1283736 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4e89d529[solrj_test_core_props_shard1_replica1] main]
[junit4] 2> 1283736 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1283737 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_test_core_props_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1283737 INFO (qtp1108400643-12617) [n:127.0.0.1:57624_solr c:solrj_test_core_props s:shard1 x:solrj_
[...truncated too long message...]
se.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Unable to create core [solrj_test_splitshard_shard1_replica1]
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:902)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:826)
[junit4] 2> ... 36 more
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Could not load collection from ZK: solrj_implicit
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1098)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:638)
[junit4] 2> at org.apache.solr.common.cloud.ClusterState.getShardId(ClusterState.java:277)
[junit4] 2> at org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1329)
[junit4] 2> at org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1287)
[junit4] 2> at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1393)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:884)
[junit4] 2> ... 37 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/solrj_implicit/state.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:356)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:353)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1096)
[junit4] 2> ... 43 more
[junit4] 2>
[junit4] 2> 1324865 INFO (qtp357673595-12593) [n:127.0.0.1:40694_solr c:solrj_test_splitshard s:shard2 x:solrj_test_splitshard_shard2_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_test_splitshard_shard2_replica1&action=CREATE&numShards=2&collection=solrj_test_splitshard&shard=shard2&wt=javabin&version=2} status=400 QTime=168437
[junit4] 2> 1324865 INFO (qtp852841910-12613) [n:127.0.0.1:40572_solr c:solrj_test_splitshard s:shard1 x:solrj_test_splitshard_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=solrj_test_splitshard_shard1_replica1&action=CREATE&numShards=2&collection=solrj_test_splitshard&shard=shard1&wt=javabin&version=2} status=400 QTime=168495
[junit4] 2> 1324866 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53007 53007
[junit4] 2> 1324954 INFO (Thread-3893) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53007 53007
[junit4] 2> 1324955 WARN (Thread-3893) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/collections/solrj_test/state.json
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/replicaProperties/state.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 5 /solr/collections/balancedProperties/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 5 /solr/collections/solrj_newstateformat/state.json
[junit4] 2> 3 /solr/collections/solrj_implicit/state.json
[junit4] 2> 3 /solr/collections/solrj_replicatests/state.json
[junit4] 2> 2 /solr/collections/solrj_test_splitshard/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 73 /solr/overseer/queue
[junit4] 2> 12 /solr/overseer/queue-work
[junit4] 2> 9 /solr/overseer/collection-queue-work
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> 1324955 INFO (SUITE-CollectionsAPISolrJTest-seed#[8E7578B987654669]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPISolrJTest_8E7578B987654669-001
[junit4] 2> Jan 06, 2017 9:44:03 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1489, maxMBSortInHeap=7.1314682220041785, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=pt-BR, timezone=Etc/GMT-2
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=119682640,total=521142272
[junit4] 2> NOTE: All tests run in this JVM: [TestReversedWildcardFilterFactory, MetricsHandlerTest, SolrPluginUtilsTest, TestReRankQParserPlugin, TestGroupingSearch, TestConfig, SpellPossibilityIteratorTest, LeaderInitiatedRecoveryOnShardRestartTest, RequestHandlersTest, TestInitParams, SimpleMLTQParserTest, TestClusterStateMutator, QueryParsingTest, TestCloudPseudoReturnFields, OutOfBoxZkACLAndCredentialsProvidersTest, SimpleFacetsTest, DistributedFacetPivotSmallAdvancedTest, AtomicUpdatesTest, TestFieldResource, TestHdfsCloudBackupRestore, CoreAdminRequestStatusTest, TestRequestStatusCollectionAPI, TestMissingGroups, TestSolrConfigHandlerCloud, UtilsToolTest, TestConfigSetsAPIZkFailure, TestJmxMonitoredMap, TestUninvertingReader, PreAnalyzedFieldTest, TestGeoJSONResponseWriter, TestAnalyzeInfixSuggestions, TestSolrQueryResponse, SpatialRPTFieldTypeTest, TestDynamicFieldCollectionResource, MergeStrategyTest, SOLR749Test, CdcrBootstrapTest, TestLMJelinekMercerSimilarityFactory, TestTrackingShardHandlerFactory, ChangedSchemaMergeTest, TestDelegationWithHadoopAuth, JSONWriterTest, HdfsLockFactoryTest, TestScoreJoinQPScore, FullSolrCloudDistribCmdsTest, BasicAuthIntegrationTest, SolrTestCaseJ4Test, HdfsRecoverLeaseTest, CurrencyFieldXmlFileTest, TestDistributedStatsComponentCardinality, ResponseLogComponentTest, RestartWhileUpdatingTest, AnalyticsMergeStrategyTest, LukeRequestHandlerTest, TermVectorComponentDistributedTest, TestRTimerTree, TestLFUCache, SharedFSAutoReplicaFailoverUtilsTest, PingRequestHandlerTest, TestRebalanceLeaders, TestExtendedDismaxParser, TestMergePolicyConfig, DocValuesMultiTest, PrimUtilsTest, BadComponentTest, UnloadDistributedZkTest, HdfsDirectoryFactoryTest, DirectUpdateHandlerOptimizeTest, TestComplexPhraseLeadingWildcard, TestHdfsUpdateLog, CircularListTest, CleanupOldIndexTest, OverseerTaskQueueTest, TestShardHandlerFactory, CdcrRequestHandlerTest, TestSolrQueryParser, ConnectionManagerTest, SolrIndexMetricsTest, TimeZoneUtilsTest, SolrCoreMetricManagerTest, SolrCoreCheckLockOnStartupTest, TestSearcherReuse, TestMinMaxOnMultiValuedField, CollectionStateFormat2Test, TestUnifiedSolrHighlighter, TestRecovery, NoCacheHeaderTest, FieldMutatingUpdateProcessorTest, DistributedQueryComponentCustomSortTest, FacetPivotSmallTest, BitVectorTest, RequestLoggingTest, TestUtils, HdfsBasicDistributedZk2Test, TestIndexingPerformance, TestMacros, CdcrUpdateLogTest, TestNonDefinedSimilarityFactory, TestBinaryResponseWriter, SolrJmxReporterTest, TestXIncludeConfig, TestXmlQParserPlugin, DeleteInactiveReplicaTest, MetricUtilsTest, TestSubQueryTransformerCrossCore, HardAutoCommitTest, UpdateParamsTest, CoreSorterTest, TestDFRSimilarityFactory, BlockDirectoryTest, BasicDistributedZkTest, SyncSliceTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, TestZkChroot, AutoCommitTest, ZkControllerTest, TestStressReorder, TestJoin, TestStressVersions, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, BasicFunctionalityTest, TestLazyCores, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, SolrIndexSplitterTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, CoreAdminHandlerTest, SuggesterTSTTest, SuggesterTest, TestTrie, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, DebugComponentTest, DisMaxRequestHandlerTest, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, TermsComponentTest, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, IndexSchemaTest, TestCollationField, TestCSVResponseWriter, TestPHPSerializedResponseWriter, SearchHandlerTest, OpenExchangeRatesOrgProviderTest, DateMathParserTest, DOMUtilTest, ClusterStateTest, TestDocumentBuilder, SliceStateTest, FileUtilsTest, TestRTGBase, DistributedIntervalFacetingTest, CloudExitableDirectoryReaderTest, CollectionsAPISolrJTest]
[junit4] Completed [450/677 (1!)] on J2 in 171.89s, 12 tests, 1 error <<< FAILURES!
[...truncated 63178 lines...]
[JENKINS] Lucene-Solr-Tests-6.x - Build # 655 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/655/
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.ltr.model.TestLinearModel
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([AC70116F38CD4793]:0)
Build Log:
[...truncated 19322 lines...]
[junit4] Suite: org.apache.solr.ltr.model.TestLinearModel
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/init-core-data-001
[junit4] 2> 36986 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 36986 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 36992 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 36999 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=example
[junit4] 2> 37005 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.s.IndexSchema Loaded schema example/1.5 with uniqueid field id
[junit4] 2> 37009 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
[junit4] 2> 37010 WARN (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 37012 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@516a0efe
[junit4] 2> 37012 WARN (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 37014 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@516a0efe
[junit4] 2> 37014 WARN (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 37014 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@516a0efe
[junit4] 2> 37020 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 37034 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=example
[junit4] 2> 37040 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema example/1.5 with uniqueid field id
[junit4] 2> 37042 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/contrib/ltr/src/test-files/solr/collection1
[junit4] 2> 37042 WARN (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 37043 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@516a0efe
[junit4] 2> 37043 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/contrib/ltr/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/init-core-data-001/]
[junit4] 2> 37064 WARN (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
[junit4] 2> 37072 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 37072 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 37072 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 37072 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: if uncommited for 1000ms;
[junit4] 2> 37074 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4df5d481[collection1] main]
[junit4] 2> 37074 WARN (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/contrib/ltr/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 37074 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.ltr.store.rest.ManagedFeatureStore for path /schema/feature-store
[junit4] 2> 37074 WARN (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/feature-store
[junit4] 2> 37074 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.l.s.r.ManagedFeatureStore ------ managed feature ~ loading ------
[junit4] 2> 37074 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.ManagedResource Notified 1 observers of /schema/feature-store
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.RestManager Registered new managed resource /schema/feature-store
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.ltr.store.rest.ManagedModelStore for path /schema/model-store
[junit4] 2> 37075 WARN (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/model-store
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.l.s.r.ManagedModelStore INIT model store
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.l.s.r.ManagedModelStore ------ managed models ~ loading ------
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.ManagedResource Notified 1 observers of /schema/model-store
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.r.RestManager Registered new managed resource /schema/model-store
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 37075 INFO (searcherExecutor-372-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4df5d481[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 37075 INFO (coreLoadExecutor-371-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555830466819391488
[junit4] 2> 37079 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 37082 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 37082 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 37082 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-003/cores/core
[junit4] 2> 37083 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 37085 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f224ced{/solr,null,AVAILABLE}
[junit4] 2> 37085 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@140c500e{HTTP/1.1,[http/1.1]}{127.0.0.1:49587}
[junit4] 2> 37086 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.e.j.s.Server Started @38033ms
[junit4] 2> 37086 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49587, configSetBaseDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-001, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-003/cores}
[junit4] 2> 37086 ERROR (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 37086 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.4.0
[junit4] 2> 37086 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 37086 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 37086 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-07T02:19:16.899Z
[junit4] 2> 37086 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-001/solr.xml
[junit4] 2> 37091 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 37093 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-003/cores
[junit4] 2> 37093 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 37100 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 37124 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=example
[junit4] 2> 37133 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema example/1.5 with uniqueid field id
[junit4] 2> 37135 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-001/collection1
[junit4] 2> 37135 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-003/cores/core/data/]
[junit4] 2> 37143 WARN (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
[junit4] 2> 37143 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 37143 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 37143 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 37144 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: if uncommited for 1000ms;
[junit4] 2> 37144 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@548808bd[collection1] main]
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-ltr/test/J1/temp/solr.ltr.model.TestLinearModel_AC70116F38CD4793-001/tempDir-001/collection1/conf
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.ltr.store.rest.ManagedFeatureStore for path /schema/feature-store
[junit4] 2> 37145 WARN (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/feature-store
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.l.s.r.ManagedFeatureStore ------ managed feature ~ loading ------
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.ManagedResource Notified 1 observers of /schema/feature-store
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.RestManager Registered new managed resource /schema/feature-store
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.ltr.store.rest.ManagedModelStore for path /schema/model-store
[junit4] 2> 37145 WARN (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/model-store
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.l.s.r.ManagedModelStore INIT model store
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.l.s.r.ManagedModelStore ------ managed models ~ loading ------
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.ManagedResource Notified 1 observers of /schema/model-store
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.r.RestManager Registered new managed resource /schema/model-store
[junit4] 2> 37145 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 37146 INFO (searcherExecutor-383-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@548808bd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 37146 INFO (coreLoadExecutor-382-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555830466893840384
[junit4] 2> 37170 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrJettyTestBase Jetty Assigned Port#49587
[junit4] 2> 37181 INFO (qtp42129657-460) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={stream.body=<add><doc><field+name%3D"title">bloomberg+different+bla</field><field+name%3D"description">bloomberg</field><field+name%3D"id">6</field><field+name%3D"popularity">1</field></doc></add>}{add=[6 (1555830466925297664)]} 0 5
[junit4] 2> 37187 INFO (qtp42129657-457) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={stream.body=<add><doc><field+name%3D"title">bloomberg+bloomberg+</field><field+name%3D"description">bloomberg</field><field+name%3D"id">7</field><field+name%3D"popularity">2</field></doc></add>}{add=[7 (1555830466935783424)]} 0 1
[junit4] 2> 37189 INFO (qtp42129657-461) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={stream.body=<add><doc><field+name%3D"title">bloomberg+bloomberg+bloomberg</field><field+name%3D"description">bloomberg</field><field+name%3D"id">8</field><field+name%3D"popularity">3</field></doc></add>}{add=[8 (1555830466938929152)]} 0 0
[junit4] 2> 37194 INFO (qtp42129657-463) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={stream.body=<add><doc><field+name%3D"title">bloomberg+bloomberg+bloomberg+bloomberg</field><field+name%3D"description">bloomberg</field><field+name%3D"id">9</field><field+name%3D"popularity">5</field></doc></add>}{add=[9 (1555830466944172032)]} 0 0
[junit4] 2> 37196 INFO (qtp42129657-463) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 37197 INFO (qtp42129657-463) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3b3723ac
[junit4] 2> 37210 INFO (qtp42129657-463) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4dd12d2f[collection1] main]
[junit4] 2> 37210 INFO (qtp42129657-463) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 37211 INFO (searcherExecutor-383-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4dd12d2f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C4)))}
[junit4] 2> 37211 INFO (qtp42129657-463) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={stream.body=<commit/>}{commit=} 0 14
[junit4] 2> 37215 INFO (TEST-TestLinearModel.getInstanceTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting getInstanceTest
[junit4] 2> 37246 INFO (TEST-TestLinearModel.getInstanceTest-seed#[AC70116F38CD4793]) [ ] o.a.s.l.s.r.ManagedModelStore adding model test1
[junit4] 2> 37246 INFO (TEST-TestLinearModel.getInstanceTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending getInstanceTest
[junit4] 2> 37250 INFO (TEST-TestLinearModel.missingFeatureWeightTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting missingFeatureWeightTest
[junit4] 2> 37250 INFO (TEST-TestLinearModel.missingFeatureWeightTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending missingFeatureWeightTest
[junit4] 2> 37254 INFO (TEST-TestLinearModel.nullFeatureWeightsTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting nullFeatureWeightsTest
[junit4] 2> 37255 INFO (TEST-TestLinearModel.nullFeatureWeightsTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending nullFeatureWeightsTest
[junit4] 2> 37257 INFO (TEST-TestLinearModel.existingNameTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting existingNameTest
[junit4] 2> 37258 INFO (TEST-TestLinearModel.existingNameTest-seed#[AC70116F38CD4793]) [ ] o.a.s.l.s.r.ManagedModelStore adding model test3
[junit4] 2> 37258 INFO (TEST-TestLinearModel.existingNameTest-seed#[AC70116F38CD4793]) [ ] o.a.s.l.s.r.ManagedModelStore adding model test3
[junit4] 2> 37258 INFO (TEST-TestLinearModel.existingNameTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending existingNameTest
[junit4] 2> 37261 INFO (TEST-TestLinearModel.emptyFeaturesTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting emptyFeaturesTest
[junit4] 2> 37261 INFO (TEST-TestLinearModel.emptyFeaturesTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending emptyFeaturesTest
[junit4] 2> 37265 INFO (TEST-TestLinearModel.duplicateFeatureTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting duplicateFeatureTest
[junit4] 2> 37265 INFO (TEST-TestLinearModel.duplicateFeatureTest-seed#[AC70116F38CD4793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending duplicateFeatureTest
[junit4] 2> 37266 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@140c500e{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 37266 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=603866309
[junit4] 2> 37267 INFO (coreCloseExecutor-388-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7a1bc93a
[junit4] 2> 37269 INFO (coreCloseExecutor-388-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 37269 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 37270 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3f224ced{/solr,null,UNAVAILABLE}
[junit4] 2> 37270 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 37270 INFO (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=553228966
[junit4] 2> Jan 07, 2017 4:19:16 AM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.solr.ltr.model.TestLinearModel
[junit4] 2> ==== jstack at approximately timeout time ====
[junit4] 2> "searcherExecutor-372-thread-1" ID=456 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@71efcacf
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> - waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@71efcacf
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> "Thread-154" ID=454 WAITING on java.lang.Object@66a702bd
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.Object@66a702bd
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:1331)
[junit4] 2>
[junit4] 2> "solr-idle-connections-evictor" ID=452 TIMED_WAITING
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:247)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> "solr-idle-connections-evictor" ID=451 TIMED_WAITING
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:247)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> "SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker" ID=450 WAITING on org.apache.solr.core.CloserThread@f7524f3
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on org.apache.solr.core.CloserThread@f7524f3
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:644)
[junit4] 2> at org.apache.solr.util.TestHarness.close(TestHarness.java:377)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:728)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:258)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> "SUITE-TestLinearModel-seed#[AC70116F38CD4793]" ID=449 RUNNABLE
[junit4] 2> at sun.management.ThreadImpl.dumpThreads0(Native Method)
[junit4] 2> at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:675)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> - locked java.lang.Object@4054bbfd
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
[junit4] 2>
[junit4] 2> "JUnit4-serializer-daemon" ID=9 TIMED_WAITING
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2>
[junit4] 2> "Signal Dispatcher" ID=4 RUNNABLE
[junit4] 2>
[junit4] 2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@1ef62d23
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.ref.ReferenceQueue$Lock@1ef62d23
[junit4] 2> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
[junit4] 2> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
[junit4] 2> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
[junit4] 2>
[junit4] 2> "Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@11c03580
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.ref.Reference$Lock@11c03580
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
[junit4] 2> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
[junit4] 2>
[junit4] 2> "main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$2@30d2c0f4
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$2@30d2c0f4
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:243)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:354)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
[junit4] 2>
[junit4] 2> ^^==============================================
[junit4] 2>
[junit4] 2> Jan 07, 2017 4:19:16 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 5 leaked thread(s).
[junit4] 2> Jan 07, 2017 4:19:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 5 threads leaked from SUITE scope at org.apache.solr.ltr.model.TestLinearModel:
[junit4] 2> 1) Thread[id=451, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestLinearModel]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:247)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=452, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestLinearModel]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:247)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3) Thread[id=456, name=searcherExecutor-372-thread-1, state=WAITING, group=TGRP-TestLinearModel]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4) Thread[id=454, name=Thread-154, state=WAITING, group=TGRP-TestLinearModel]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:1331)
[junit4] 2> 5) Thread[id=450, name=SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker, state=WAITING, group=TGRP-TestLinearModel]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:644)
[junit4] 2> at org.apache.solr.util.TestHarness.close(TestHarness.java:377)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:728)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:258)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Jan 07, 2017 4:19:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=451, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestLinearModel]
[junit4] 2> 2) Thread[id=452, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestLinearModel]
[junit4] 2> 3) Thread[id=456, name=searcherExecutor-372-thread-1, state=WAITING, group=TGRP-TestLinearModel]
[junit4] 2> 4) Thread[id=454, name=Thread-154, state=WAITING, group=TGRP-TestLinearModel]
[junit4] 2> 5) Thread[id=450, name=SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker, state=WAITING, group=TGRP-TestLinearModel]
[junit4] 2> 7257128 INFO (coreCloseExecutor-390-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@53adf394
[junit4] 2> 7257133 INFO (coreCloseExecutor-390-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 7257134 WARN (SUITE-TestLinearModel-seed#[AC70116F38CD4793]-worker) [ ] o.a.s.m.SolrMetricManager Interrupted while trying to obtain lock to modify reporters registry: solr.node
[junit4] 2> Jan 07, 2017 4:19:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {_version_=PostingsFormat(name=LuceneVarGapFixedInterval), popularity=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), description=PostingsFormat(name=Direct), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=PostingsFormat(name=Memory doPackFST= true), title=PostingsFormat(name=Direct)}, docValues:{}, maxPointsInLeafNode=1884, maxMBSortInHeap=6.577478465027899, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=en-GB, timezone=Atlantic/St_Helena
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=238839256,total=321388544
[junit4] 2> NOTE: All tests run in this JVM: [TestLTRScoringQuery, TestEdisMaxSolrFeature, TestFeatureStore, TestLTRQParserExplain, TestFeatureExtractionFromMultipleSegments, TestLTRWithSort, TestRerankBase, TestExternalFeatures, TestFeatureLogging, TestFieldValueFeature, TestFilterSolrFeature, TestNoMatchSolrFeature, TestOriginalScoreFeature, TestOriginalScoreScorer, TestUserTermScoreWithQ, TestUserTermScorerQuery, TestValueFeature, TestLinearModel]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestLinearModel -Dtests.seed=AC70116F38CD4793 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=en-GB -Dtests.timezone=Atlantic/St_Helena -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestLinearModel (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([AC70116F38CD4793]:0)
[junit4] Completed [35/35 (1!)] on J1 in 7220.18s, 6 tests, 1 error <<< FAILURES!
[...truncated 56170 lines...]