You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/10/02 15:49:53 UTC
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 220 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/220/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC
3 tests failed.
FAILED: org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelExecutorStream
Error Message:
Error from server at http://127.0.0.1:49224/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason: <pre> Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:49224/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre> Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([8FC03EAD54C6D7C5:32D74BB46DEAEA98]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelExecutorStream(StreamExpressionTest.java:7540)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49224/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre> Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
FAILED: org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
Error Message:
Can not find doc 1 in http://127.0.0.1:37709/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 1 in http://127.0.0.1:37709/solr
at __randomizedtesting.SeedInfo.seed([451BDD439F6DF8BE:C3DA25AEC03C2E5E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:861)
at org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates(TestTlogReplica.java:664)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([451BDD439F6DF8BE:591AA0CEEAC8862D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:490)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13421 lines...]
[junit4] Suite: org.apache.solr.cloud.TestTlogReplica
[junit4] 2> 3586888 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/init-core-data-001
[junit4] 2> 3586888 WARN (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=73 numCloses=73
[junit4] 2> 3586888 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 3586889 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 3586890 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001
[junit4] 2> 3586890 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3586890 INFO (Thread-7323) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3586890 INFO (Thread-7323) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3586892 ERROR (Thread-7323) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3586990 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:49241
[junit4] 2> 3587006 INFO (jetty-launcher-4146-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3587006 INFO (jetty-launcher-4146-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3587010 INFO (jetty-launcher-4146-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3df3c75f{/solr,null,AVAILABLE}
[junit4] 2> 3587011 INFO (jetty-launcher-4146-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6921e663{HTTP/1.1,[http/1.1]}{127.0.0.1:37709}
[junit4] 2> 3587011 INFO (jetty-launcher-4146-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@361c400b{/solr,null,AVAILABLE}
[junit4] 2> 3587011 INFO (jetty-launcher-4146-thread-1) [ ] o.e.j.s.Server Started @3590217ms
[junit4] 2> 3587011 INFO (jetty-launcher-4146-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37709}
[junit4] 2> 3587011 INFO (jetty-launcher-4146-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6734302d{HTTP/1.1,[http/1.1]}{127.0.0.1:48107}
[junit4] 2> 3587012 ERROR (jetty-launcher-4146-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3587012 INFO (jetty-launcher-4146-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 3587012 INFO (jetty-launcher-4146-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3587012 INFO (jetty-launcher-4146-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3587012 INFO (jetty-launcher-4146-thread-2) [ ] o.e.j.s.Server Started @3590217ms
[junit4] 2> 3587012 INFO (jetty-launcher-4146-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T15:23:32.240Z
[junit4] 2> 3587012 INFO (jetty-launcher-4146-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48107}
[junit4] 2> 3587013 ERROR (jetty-launcher-4146-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3587013 INFO (jetty-launcher-4146-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 3587013 INFO (jetty-launcher-4146-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3587013 INFO (jetty-launcher-4146-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3587013 INFO (jetty-launcher-4146-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T15:23:32.241Z
[junit4] 2> 3587018 INFO (jetty-launcher-4146-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3587018 INFO (jetty-launcher-4146-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3587032 INFO (jetty-launcher-4146-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49241/solr
[junit4] 2> 3587032 INFO (jetty-launcher-4146-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49241/solr
[junit4] 2> 3587161 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3587161 INFO (jetty-launcher-4146-thread-2) [n:127.0.0.1:48107_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3587161 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37709_solr
[junit4] 2> 3587162 INFO (jetty-launcher-4146-thread-2) [n:127.0.0.1:48107_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48107_solr
[junit4] 2> 3587163 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.c.Overseer Overseer (id=98759987175030789-127.0.0.1:37709_solr-n_0000000000) starting
[junit4] 2> 3587164 INFO (zkCallback-4158-thread-1-processing-n:127.0.0.1:48107_solr) [n:127.0.0.1:48107_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3587165 INFO (zkCallback-4157-thread-1-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3587172 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37709_solr
[junit4] 2> 3587174 INFO (zkCallback-4157-thread-1-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3587182 INFO (zkCallback-4158-thread-1-processing-n:127.0.0.1:48107_solr) [n:127.0.0.1:48107_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3587260 INFO (jetty-launcher-4146-thread-2) [n:127.0.0.1:48107_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48107.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3587260 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37709.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3587266 INFO (jetty-launcher-4146-thread-2) [n:127.0.0.1:48107_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48107.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3587266 INFO (jetty-launcher-4146-thread-2) [n:127.0.0.1:48107_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48107.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3587266 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37709.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3587266 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37709.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3587266 INFO (jetty-launcher-4146-thread-2) [n:127.0.0.1:48107_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/.
[junit4] 2> 3587267 INFO (jetty-launcher-4146-thread-1) [n:127.0.0.1:37709_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/.
[junit4] 2> 3587315 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3587316 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49241/solr ready
[junit4] 2> 3587320 INFO (SUITE-TestTlogReplica-seed#[451BDD439F6DF8BE]-worker) [ ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
[junit4] 2> 3587322 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3587323 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3587340 INFO (TEST-TestTlogReplica.testCreateDelete-seed#[451BDD439F6DF8BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateDelete {seed=[451BDD439F6DF8BE:5E0B2C0F699D008E]}
[junit4] 2> 3587341 INFO (qtp16842419-29764) [n:127.0.0.1:48107_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_create_delete&nrtReplicas=0&action=CREATE&numShards=2&tlogReplicas=4&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3587345 INFO (OverseerThreadFactory-11470-thread-1-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_create_delete
[junit4] 2> 3587346 WARN (OverseerThreadFactory-11470-thread-1-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 4 on collection tlog_replica_test_create_delete is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 3587461 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37709/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587468 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48107/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587475 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37709/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587480 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48107/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587486 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37709/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587492 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48107/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587496 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t12",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37709/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587500 INFO (OverseerStateUpdate-98759987175030789-127.0.0.1:37709_solr-n_0000000000) [n:127.0.0.1:37709_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t14",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48107/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 3587704 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t2&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587706 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3587709 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t4&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587709 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t1&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587709 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3587711 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t8&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587714 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t6&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587714 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t10&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587717 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t14&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587717 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t12&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3587848 INFO (zkCallback-4158-thread-1-processing-n:127.0.0.1:48107_solr) [n:127.0.0.1:48107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3587848 INFO (zkCallback-4157-thread-1-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3587849 INFO (zkCallback-4158-thread-2-processing-n:127.0.0.1:48107_solr) [n:127.0.0.1:48107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3587849 INFO (zkCallback-4157-thread-2-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3588739 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588742 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588748 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588754 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588754 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588762 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588775 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t8] Schema name=minimal
[junit4] 2> 3588777 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t10] Schema name=minimal
[junit4] 2> 3588778 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588778 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t8' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588778 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37709.solr.core.tlog_replica_test_create_delete.shard2.replica_t8' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588778 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588778 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t8] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/tlog_replica_test_create_delete_shard2_replica_t8], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard2_replica_t8/data/]
[junit4] 2> 3588779 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t14] Schema name=minimal
[junit4] 2> 3588779 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588779 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t10' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588780 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48107.solr.core.tlog_replica_test_create_delete.shard2.replica_t10' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588780 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588780 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t10] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/tlog_replica_test_create_delete_shard2_replica_t10], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard2_replica_t10/data/]
[junit4] 2> 3588780 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t1] Schema name=minimal
[junit4] 2> 3588781 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588781 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t14' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588781 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48107.solr.core.tlog_replica_test_create_delete.shard2.replica_t14' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588781 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588781 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t14] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/tlog_replica_test_create_delete_shard2_replica_t14], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard2_replica_t14/data/]
[junit4] 2> 3588782 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588782 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t1' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588782 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37709.solr.core.tlog_replica_test_create_delete.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588783 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588783 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/tlog_replica_test_create_delete_shard1_replica_t1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard1_replica_t1/data/]
[junit4] 2> 3588785 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t6] Schema name=minimal
[junit4] 2> 3588787 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588787 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t6' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588787 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48107.solr.core.tlog_replica_test_create_delete.shard1.replica_t6' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588787 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588787 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/tlog_replica_test_create_delete_shard1_replica_t6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard1_replica_t6/data/]
[junit4] 2> 3588792 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588798 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t2] Schema name=minimal
[junit4] 2> 3588801 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t12] Schema name=minimal
[junit4] 2> 3588802 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 3588804 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588804 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t12' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588804 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37709.solr.core.tlog_replica_test_create_delete.shard2.replica_t12' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588804 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588804 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t12] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/tlog_replica_test_create_delete_shard2_replica_t12], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard2_replica_t12/data/]
[junit4] 2> 3588808 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588808 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t2' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588808 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48107.solr.core.tlog_replica_test_create_delete.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588809 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588809 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/tlog_replica_test_create_delete_shard1_replica_t2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard1_replica_t2/data/]
[junit4] 2> 3588809 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t4] Schema name=minimal
[junit4] 2> 3588811 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 3588811 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t4' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 3588812 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37709.solr.core.tlog_replica_test_create_delete.shard1.replica_t4' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10ced4ff
[junit4] 2> 3588812 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3588812 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/tlog_replica_test_create_delete_shard1_replica_t4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_451BDD439F6DF8BE-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard1_replica_t4/data/]
[junit4] 2> 3588899 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588899 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588900 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588900 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588901 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588901 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588902 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588902 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588903 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.s.SolrIndexSearcher Opening [Searcher@19775733[tlog_replica_test_create_delete_shard2_replica_t10] main]
[junit4] 2> 3588904 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.s.SolrIndexSearcher Opening [Searcher@5ee1470c[tlog_replica_test_create_delete_shard2_replica_t14] main]
[junit4] 2> 3588906 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588906 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588907 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588907 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796914421760
[junit4] 2> 3588909 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588912 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588915 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588915 INFO (qtp16842419-29763) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796922810368
[junit4] 2> 3588914 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=4 found=1 timeoutin=9999ms
[junit4] 2> 3588918 INFO (searcherExecutor-11477-thread-1-processing-n:127.0.0.1:48107_solr x:tlog_replica_test_create_delete_shard2_replica_t14 s:shard2 c:tlog_replica_test_create_delete r:core_node16) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t14] Registered new searcher Searcher@5ee1470c[tlog_replica_test_create_delete_shard2_replica_t14] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588919 INFO (searcherExecutor-11476-thread-1-processing-n:127.0.0.1:48107_solr x:tlog_replica_test_create_delete_shard2_replica_t10 s:shard2 c:tlog_replica_test_create_delete r:core_node13) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t10] Registered new searcher Searcher@19775733[tlog_replica_test_create_delete_shard2_replica_t10] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588920 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588920 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588922 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588922 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588924 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.s.SolrIndexSearcher Opening [Searcher@39add213[tlog_replica_test_create_delete_shard2_replica_t8] main]
[junit4] 2> 3588925 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588925 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588926 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588926 INFO (qtp315338434-29757) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796934344704
[junit4] 2> 3588926 INFO (searcherExecutor-11475-thread-1-processing-n:127.0.0.1:37709_solr x:tlog_replica_test_create_delete_shard2_replica_t8 s:shard2 c:tlog_replica_test_create_delete r:core_node11) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t8] Registered new searcher Searcher@39add213[tlog_replica_test_create_delete_shard2_replica_t8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588929 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588929 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588930 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588931 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588931 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.s.SolrIndexSearcher Opening [Searcher@4a3da183[tlog_replica_test_create_delete_shard2_replica_t12] main]
[junit4] 2> 3588933 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588933 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588934 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588934 INFO (qtp315338434-29759) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796942733312
[junit4] 2> 3588934 INFO (searcherExecutor-11480-thread-1-processing-n:127.0.0.1:37709_solr x:tlog_replica_test_create_delete_shard2_replica_t12 s:shard2 c:tlog_replica_test_create_delete r:core_node15) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t12] Registered new searcher Searcher@4a3da183[tlog_replica_test_create_delete_shard2_replica_t12] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588940 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588940 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588941 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588941 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588942 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@257c04ad[tlog_replica_test_create_delete_shard1_replica_t1] main]
[junit4] 2> 3588945 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588945 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588949 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588949 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588950 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.s.SolrIndexSearcher Opening [Searcher@3f1efc8f[tlog_replica_test_create_delete_shard1_replica_t4] main]
[junit4] 2> 3588952 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588952 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588953 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588953 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796962656256
[junit4] 2> 3588955 INFO (searcherExecutor-11482-thread-1-processing-n:127.0.0.1:37709_solr x:tlog_replica_test_create_delete_shard1_replica_t4 s:shard1 c:tlog_replica_test_create_delete r:core_node7) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t4] Registered new searcher Searcher@3f1efc8f[tlog_replica_test_create_delete_shard1_replica_t4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588959 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=4 found=1 timeoutin=9999ms
[junit4] 2> 3588959 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588959 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588960 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588960 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588960 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3588960 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3588961 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588961 INFO (qtp315338434-29755) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796971044864
[junit4] 2> 3588961 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588961 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588962 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3588962 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3588962 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.s.SolrIndexSearcher Opening [Searcher@36c8130[tlog_replica_test_create_delete_shard1_replica_t6] main]
[junit4] 2> 3588963 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588964 INFO (searcherExecutor-11478-thread-1-processing-n:127.0.0.1:37709_solr x:tlog_replica_test_create_delete_shard1_replica_t1 s:shard1 c:tlog_replica_test_create_delete r:core_node3) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t1] Registered new searcher Searcher@257c04ad[tlog_replica_test_create_delete_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588964 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b9731a1[tlog_replica_test_create_delete_shard1_replica_t2] main]
[junit4] 2> 3588964 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588964 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588965 INFO (qtp16842419-29760) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796975239168
[junit4] 2> 3588965 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 3588965 INFO (searcherExecutor-11479-thread-1-processing-n:127.0.0.1:48107_solr x:tlog_replica_test_create_delete_shard1_replica_t6 s:shard1 c:tlog_replica_test_create_delete r:core_node9) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t6] Registered new searcher Searcher@36c8130[tlog_replica_test_create_delete_shard1_replica_t6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588965 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 3588966 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3588967 INFO (searcherExecutor-11481-thread-1-processing-n:127.0.0.1:48107_solr x:tlog_replica_test_create_delete_shard1_replica_t2 s:shard1 c:tlog_replica_test_create_delete r:core_node5) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t2] Registered new searcher Searcher@5b9731a1[tlog_replica_test_create_delete_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3588967 INFO (qtp16842419-29766) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580159796977336320
[junit4] 2> 3589061 INFO (zkCallback-4157-thread-2-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3589061 INFO (zkCallback-4158-thread-2-processing-n:127.0.0.1:48107_solr) [n:127.0.0.1:48107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3589061 INFO (zkCallback-4157-thread-1-processing-n:127.0.0.1:37709_solr) [n:127.0.0.1:37709_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3589061 INFO (zkCallback-4158-thread-1-processing-n:127.0.0.1:48107_solr) [n:127.0.0.1:48107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3589420 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3589420 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3589420 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48107/solr/tlog_replica_test_create_delete_shard2_replica_t14/
[junit4] 2> 3589420 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_create_delete_shard2_replica_t14 url=http://127.0.0.1:48107/solr START replicas=[http://127.0.0.1:37709/solr/tlog_replica_test_create_delete_shard2_replica_t8/, http://127.0.0.1:48107/solr/tlog_replica_test_create_delete_shard2_replica_t10/, http://127.0.0.1:37709/solr/tlog_replica_test_create_delete_shard2_replica_t12/] nUpdates=100
[junit4] 2> 3589422 INFO (qtp315338434-29756) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.S.Request [tlog_replica_test_create_delete_shard2_replica_t12] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3589422 INFO (qtp16842419-29768) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.S.Request [tlog_replica_test_create_delete_shard2_replica_t10] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3589422 INFO (qtp315338434-29758) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.S.Request [tlog_replica_test_create_delete_shard2_replica_t8] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3589463 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3589463 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3589464 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37709/solr/tlog_replica_test_create_delete_shard1_replica_t4/
[junit4] 2> 3589464 INFO (qtp315338434-29754) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_create_delete_shard1_replica_t4 url=http://127.0.0.1:37709/solr START replicas=[http://127.0.0.1:37709/solr/tlog_replica_test_create_delete_shard1_replica_t1/, http://127.0.0.1:48107/solr/tlog_replica_test_create_delete_shard1_replica_t2/, http://127.0.0.1:48107/solr/tlog_replica_test_create_delete_shard1_replica_t6/] nUpdates=100
[junit4] 2> 3589466 INFO (qtp315338434-29756) [n:127.0.0.1:37709_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_create_delete_shard1_replica_t1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3589467 INFO (qtp16842419-29841) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_create_delete_shard1_replica_t2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3589468 INFO (qtp16842419-29842) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.S.Request [tlog_replica_test_create_delete_shard1_replica_t6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3589721 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_create_delete_shard2_replica_t14 url=http://127.0.0.1:48107/solr DONE. We have no versions. sync failed.
[junit4] 2> 3589721 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 3589721 INFO (qtp16842419-29767) [n:127.0.0.1:48107_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 3589721 INFO (qtp16842419-29767
[...truncated too long message...]
ervice url = null, agent id = null] for registry solr.core.mainCorpus.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@434f878d
[junit4] 2> 179724 INFO (coreCloseExecutor-433-thread-2) [n:127.0.0.1:49224_solr c:mainCorpus s:shard2 r:core_node4 x:mainCorpus_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.mainCorpus.shard2.leader, tag=2019152025
[junit4] 2> 179743 INFO (coreCloseExecutor-432-thread-1) [n:127.0.0.1:57911_solr c:workQueue s:shard1 r:core_node3 x:workQueue_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.workQueue.shard1.leader, tag=1815346689
[junit4] 2> 179743 INFO (coreCloseExecutor-432-thread-1) [n:127.0.0.1:57911_solr c:workQueue s:shard1 r:core_node3 x:workQueue_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 179744 INFO (coreCloseExecutor-432-thread-1) [n:127.0.0.1:57911_solr c:workQueue s:shard1 r:core_node3 x:workQueue_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3201b8b7 commitCommandVersion:0
[junit4] 2> 179753 INFO (coreCloseExecutor-433-thread-1) [n:127.0.0.1:49224_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=554598373
[junit4] 2> 179756 INFO (coreCloseExecutor-434-thread-2) [n:127.0.0.1:58930_solr c:destination s:shard1 r:core_node3 x:destination_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.destination.shard1.leader, tag=43540083
[junit4] 2> 179766 INFO (coreCloseExecutor-434-thread-1) [n:127.0.0.1:58930_solr c:mainCorpus s:shard1 r:core_node3 x:mainCorpus_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.mainCorpus.shard1.leader, tag=248217688
[junit4] 2> 179802 INFO (zkCallback-104-thread-3-processing-n:127.0.0.1:58930_solr) [n:127.0.0.1:58930_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 179805 INFO (zkCallback-101-thread-5-processing-n:127.0.0.1:57911_solr) [n:127.0.0.1:57911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 179810 INFO (zkCallback-101-thread-5-processing-n:127.0.0.1:57911_solr) [n:127.0.0.1:57911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 179822 INFO (jetty-closer-82-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98760029454991369-127.0.0.1:57911_solr-n_0000000000) closing
[junit4] 2> 179823 INFO (OverseerStateUpdate-98760029454991369-127.0.0.1:57911_solr-n_0000000000) [n:127.0.0.1:57911_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:57911_solr
[junit4] 2> 179830 INFO (jetty-closer-82-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a82fc2{/solr,null,UNAVAILABLE}
[junit4] 2> 181302 WARN (zkCallback-96-thread-1-processing-n:127.0.0.1:49224_solr) [n:127.0.0.1:49224_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 181310 WARN (zkCallback-104-thread-3-processing-n:127.0.0.1:58930_solr) [n:127.0.0.1:58930_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 181314 INFO (jetty-closer-82-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6b0955f7{/solr,null,UNAVAILABLE}
[junit4] 2> 181315 INFO (jetty-closer-82-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@66be8fec{/solr,null,UNAVAILABLE}
[junit4] 2> 181322 ERROR (SUITE-StreamExpressionTest-seed#[8FC03EAD54C6D7C5]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 181323 INFO (SUITE-StreamExpressionTest-seed#[8FC03EAD54C6D7C5]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35035 35035
[junit4] 2> 186402 INFO (Thread-113) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35035 35035
[junit4] 2> 186404 WARN (Thread-113) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 98 /solr/aliases.json
[junit4] 2> 98 /solr/clusterprops.json
[junit4] 2> 10 /solr/configs/conf
[junit4] 2> 7 /solr/configs/ml
[junit4] 2> 4 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 98 /solr/clusterstate.json
[junit4] 2> 38 /solr/collections/destinationCollection/state.json
[junit4] 2> 26 /solr/collections/parallelDestinationCollection1/state.json
[junit4] 2> 22 /solr/collections/destination/state.json
[junit4] 2> 22 /solr/collections/mainCorpus/state.json
[junit4] 2> 20 /solr/collections/parallelDestinationCollection/state.json
[junit4] 2> 19 /solr/collections/workQueue/state.json
[junit4] 2> 15 /solr/collections/collection1/state.json
[junit4] 2> 10 /solr/collections/uknownCollection/state.json
[junit4] 2> 10 /solr/collections/modelCollection/state.json
[junit4] 2> 10 /solr/collections/checkpointCollection/state.json
[junit4] 2> 2 /solr/overseer_elect/election/98760029454991372-127.0.0.1:58930_solr-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 98 /solr/live_nodes
[junit4] 2> 98 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.stream.StreamExpressionTest_8FC03EAD54C6D7C5-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {name_s=FST50, expr_s=Lucene50(blocksize=128), terms_ss=PostingsFormat(name=MockRandom), join2_s=PostingsFormat(name=MockRandom), field_s=PostingsFormat(name=Memory), multiDefault=PostingsFormat(name=MockRandom), subject=PostingsFormat(name=MockRandom), a1_s=PostingsFormat(name=Memory), a2_s=Lucene50(blocksize=128), level1_s=Lucene50(blocksize=128), body_t=FST50, s_multi=Lucene50(blocksize=128), col_s=PostingsFormat(name=Memory), a_ss=PostingsFormat(name=MockRandom), level2_s=PostingsFormat(name=Memory), a_s=Lucene50(blocksize=128), tv_text=PostingsFormat(name=Memory), term_s=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=MockRandom), text_s=Lucene50(blocksize=128), id=FST50, text=Lucene50(blocksize=128), featureSet_s=PostingsFormat(name=Memory), checkpoint_ss=FST50, test_t=FST50, ident_s=PostingsFormat(name=Memory), whitetok=FST50, side_s=FST50}, docValues:{name_s=DocValuesFormat(name=Memory), expr_s=DocValuesFormat(name=Lucene70), iteration_i=DocValuesFormat(name=Memory), terms_ss=DocValuesFormat(name=Asserting), join2_s=DocValuesFormat(name=Asserting), field_s=DocValuesFormat(name=Lucene70), multiDefault=DocValuesFormat(name=Asserting), price_f=DocValuesFormat(name=Asserting), a1_s=DocValuesFormat(name=Lucene70), a_f=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Lucene70), join1_i=DocValuesFormat(name=Lucene70), a2_s=DocValuesFormat(name=Lucene70), falseNegative_i=DocValuesFormat(name=Lucene70), a_i=DocValuesFormat(name=Memory), test_i=DocValuesFormat(name=Asserting), join3_i=DocValuesFormat(name=Memory), falsePositive_i=DocValuesFormat(name=Lucene70), field_i=DocValuesFormat(name=Asserting), level1_s=DocValuesFormat(name=Lucene70), s_multi=DocValuesFormat(name=Lucene70), col_s=DocValuesFormat(name=Lucene70), a_ss=DocValuesFormat(name=Asserting), level2_s=DocValuesFormat(name=Lucene70), a_s=DocValuesFormat(name=Lucene70), score_f=DocValuesFormat(name=Lucene70), term_s=DocValuesFormat(name=Asserting), text_s=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Asserting), i_multi=DocValuesFormat(name=Memory), featureSet_s=DocValuesFormat(name=Lucene70), trueNegative_i=DocValuesFormat(name=Lucene70), index_i=DocValuesFormat(name=Lucene70), b_ls=DocValuesFormat(name=Lucene70), test_dt=DocValuesFormat(name=Lucene70), out_i=DocValuesFormat(name=Lucene70), checkpoint_ss=DocValuesFormat(name=Memory), ident_s=DocValuesFormat(name=Lucene70), order_i=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Lucene70), side_s=DocValuesFormat(name=Memory), truePositive_i=DocValuesFormat(name=Lucene70), miles_i=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=881, maxMBSortInHeap=5.748300012256849, sim=RandomSimilarity(queryNorm=false): {}, locale=id, timezone=Pacific/Noumea
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_141 (64-bit)/cpus=3,threads=1,free=169245376,total=522190848
[junit4] 2> NOTE: All tests run in this JVM: [StreamExpressionParserTest, TestSolrJErrorHandling, TestXMLEscaping, EqualToEvaluatorTest, LBHttpSolrClientBuilderTest, TestBatchUpdate, TestEmbeddedSolrServer, FieldValueEvaluatorTest, SolrExampleXMLTest, TestHash, TestSolrProperties, UniformDistributionEvaluatorTest, CloudSolrClientCacheTest, ArcTangentEvaluatorTest, CoalesceEvaluatorTest, HyperbolicTangentEvaluatorTest, TestDocumentObjectBinder, FieldAnalysisResponseTest, ModifiableSolrParamsTest, TangentEvaluatorTest, ModuloEvaluatorTest, TestV2Request, TestValidatingJsonMap, GreaterThanEqualToEvaluatorTest, SolrZkClientTest, TestPathTrie, ArcCosineEvaluatorTest, TestConfigSetAdminRequest, TermsResponseTest, TestJavaBinCodec, StreamExpressionTest]
[junit4] Completed [96/145 (1!)] on J0 in 123.21s, 117 tests, 1 error <<< FAILURES!
[...truncated 46143 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 224 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/224/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
All tests passed
Build Log:
[...truncated 60418 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:826: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:101: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:669: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:682: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:2570: exec returned: 1
Total time: 89 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 223 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/223/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
All tests passed
Build Log:
[...truncated 60399 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:826: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:101: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:669: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:682: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:2570: exec returned: 1
Total time: 91 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 222 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/222/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=11449, name=jetty-launcher-1930-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 2) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 3) Thread[id=11516, name=jetty-launcher-1930-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=11449, name=jetty-launcher-1930-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
2) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
3) Thread[id=11516, name=jetty-launcher-1930-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
at __randomizedtesting.SeedInfo.seed([AB163D8AFF236488]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
at __randomizedtesting.SeedInfo.seed([AB163D8AFF236488]:0)
Build Log:
[...truncated 12006 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> 1382799 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_AB163D8AFF236488-001/init-core-data-001
[junit4] 2> 1382800 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 1382846 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1382848 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1382983 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_AB163D8AFF236488-001/tempDir-001
[junit4] 2> 1382983 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1382984 INFO (Thread-1876) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1382984 INFO (Thread-1876) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1382986 ERROR (Thread-1876) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1383085 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:55939
[junit4] 2> 1383182 INFO (jetty-launcher-1930-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1383184 INFO (jetty-launcher-1930-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@26a6d61{/solr,null,AVAILABLE}
[junit4] 2> 1383190 INFO (jetty-launcher-1930-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6afb11e6{SSL,[ssl, http/1.1]}{127.0.0.1:36381}
[junit4] 2> 1383190 INFO (jetty-launcher-1930-thread-2) [ ] o.e.j.s.Server Started @1385865ms
[junit4] 2> 1383190 INFO (jetty-launcher-1930-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36381}
[junit4] 2> 1383190 ERROR (jetty-launcher-1930-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1383190 INFO (jetty-launcher-1930-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1383190 INFO (jetty-launcher-1930-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1383190 INFO (jetty-launcher-1930-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1383190 INFO (jetty-launcher-1930-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T12:39:05.276Z
[junit4] 2> 1383213 INFO (jetty-launcher-1930-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1383218 INFO (jetty-launcher-1930-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1383220 INFO (jetty-launcher-1930-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1b4096e7{/solr,null,AVAILABLE}
[junit4] 2> 1383221 INFO (jetty-launcher-1930-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5007a3fd{SSL,[ssl, http/1.1]}{127.0.0.1:57908}
[junit4] 2> 1383221 INFO (jetty-launcher-1930-thread-1) [ ] o.e.j.s.Server Started @1385896ms
[junit4] 2> 1383221 INFO (jetty-launcher-1930-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=57908}
[junit4] 2> 1383221 ERROR (jetty-launcher-1930-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1383221 INFO (jetty-launcher-1930-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1383221 INFO (jetty-launcher-1930-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1383221 INFO (jetty-launcher-1930-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1383221 INFO (jetty-launcher-1930-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T12:39:05.307Z
[junit4] 2> 1383227 INFO (jetty-launcher-1930-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55939/solr
[junit4] 2> 1383234 INFO (jetty-launcher-1930-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1383245 INFO (jetty-launcher-1930-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55939/solr
[junit4] 2> 1383545 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1383553 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36381_solr
[junit4] 2> 1383555 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.Overseer Overseer (id=98765002838638596-127.0.0.1:36381_solr-n_0000000000) starting
[junit4] 2> 1383599 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1383615 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57908_solr
[junit4] 2> 1383635 INFO (zkCallback-1938-thread-1-processing-n:127.0.0.1:36381_solr) [n:127.0.0.1:36381_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1383635 INFO (zkCallback-1943-thread-1-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1383691 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36381_solr
[junit4] 2> 1383699 INFO (zkCallback-1943-thread-1-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1383717 INFO (zkCallback-1938-thread-1-processing-n:127.0.0.1:36381_solr) [n:127.0.0.1:36381_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1383781 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 1383790 WARN (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1383802 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 1383947 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 1383947 WARN (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1383952 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 1383974 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 1383974 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 1384019 INFO (jetty-launcher-1930-thread-2-EventThread) [n:127.0.0.1:36381_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 1384021 INFO (jetty-launcher-1930-thread-1-EventThread) [n:127.0.0.1:57908_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 1384374 WARN (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1384391 WARN (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1384463 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36381.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1dcaea79
[junit4] 2> 1384477 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57908.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1dcaea79
[junit4] 2> 1384485 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57908.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1dcaea79
[junit4] 2> 1384485 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57908.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1dcaea79
[junit4] 2> 1384486 INFO (jetty-launcher-1930-thread-1) [n:127.0.0.1:57908_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_AB163D8AFF236488-001/tempDir-001/node1/.
[junit4] 2> 1384494 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36381.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1dcaea79
[junit4] 2> 1384494 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36381.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1dcaea79
[junit4] 2> 1384496 INFO (jetty-launcher-1930-thread-2) [n:127.0.0.1:36381_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_AB163D8AFF236488-001/tempDir-001/node2/.
[junit4] 2> 1384708 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 1384803 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1507070346853&s=xOVzj5ZPiOiHnU1dw2z83G89Avs="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:06 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:06 GMT
[junit4] 2> 1384804 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 1384898 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 1399972 WARN (jetty-launcher-1930-thread-1-SendThread(127.0.0.1:55939)) [n:127.0.0.1:57908_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15481ms for sessionid 0x15ee23f2e700006
[junit4] 2> 1399972 WARN (jetty-launcher-1930-thread-1-SendThread(127.0.0.1:55939)) [n:127.0.0.1:57908_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15574ms for sessionid 0x15ee23f2e700007
[junit4] 2> 1399973 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15ee23f2e700007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1399973 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15575ms for sessionid 0x15ee23f2e700008
[junit4] 2> 1399973 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15ee23f2e700006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1399973 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15474ms for sessionid 0x15ee23f2e700004
[junit4] 2> 1399973 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15ee23f2e700008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1399973 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15ee23f2e700004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1399977 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1507070346990&s=aOsWUG24ZpzPzys1zk04A5hL6o0="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:06 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:06 GMT
[junit4] 2> 1399977 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 1400009 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 1400026 INFO (qtp1495329247-11399) [n:127.0.0.1:36381_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1400026 INFO (qtp1495329247-11399) [n:127.0.0.1:36381_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1400028 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1507070362108&s=rKgqVxKwTkdGyBGpiBdxI3efc2k="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1400029 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 1400070 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 1400077 WARN (zkCallback-1943-thread-3-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@774efbc9 name: ZooKeeperConnection Watcher:127.0.0.1:55939/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 1400077 WARN (zkCallback-1943-thread-3-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 1400078 INFO (jetty-launcher-1930-thread-2-EventThread) [n:127.0.0.1:36381_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 1400087 WARN (zkCallback-1938-thread-4-processing-n:127.0.0.1:36381_solr) [n:127.0.0.1:36381_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4b915665 name: ZooKeeperConnection Watcher:127.0.0.1:55939/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 1400087 WARN (zkCallback-1938-thread-4-processing-n:127.0.0.1:36381_solr) [n:127.0.0.1:36381_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 1400091 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1507070362165&s=vveYhKTqEdjPQ15pG5I+NtUhPuY="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1400092 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 1400160 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 1400189 WARN (qtp1495329247-11408) [ ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 1400191 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1507070362246&s=/awqrEEsMd41s5zI80LNEhSsW00="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1400192 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 1400266 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 1400270 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1507070362353&s=xp8FAlTGkBS6CtYIgUO8kFoEDjw="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1400273 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 1400325 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 1400351 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1507070362412&s=vSIb9xPnzmzYW5E/RHQnf+UPmdE="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1400352 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 1400485 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 1400523 INFO (qtp1495329247-11402) [n:127.0.0.1:36381_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1400523 INFO (qtp1495329247-11402) [n:127.0.0.1:36381_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1400525 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1507070362573&s=DSqCZYrHcg72mlrExQgwykbUC6M="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1400525 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 1400562 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 1400563 INFO (qtp1495329247-11406) [n:127.0.0.1:36381_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1400563 INFO (qtp1495329247-11406) [n:127.0.0.1:36381_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1400569 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1507070362649&s=jNUfv9xcIA0rDtaQrMLbTWExScQ="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1400569 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 1400628 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 1410733 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1507070362715&s=tE1WUjTuqylnApRjh76R6urwy+g="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:22 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:22 GMT
[junit4] 2> 1410733 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 1410733 WARN (jetty-launcher-1930-thread-1-SendThread(127.0.0.1:55939)) [n:127.0.0.1:57908_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee23f2e700006 has expired
[junit4] 2> 1410736 WARN (jetty-launcher-1930-thread-1-SendThread(127.0.0.1:55939)) [n:127.0.0.1:57908_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee23f2e700007 has expired
[junit4] 2> 1410739 WARN (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@774efbc9 name: ZooKeeperConnection Watcher:127.0.0.1:55939/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 1410740 WARN (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 1410740 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1410741 WARN (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 1410739 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee23f2e700008 has expired
[junit4] 2> 1410750 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 1410750 INFO (zkCallback-1938-thread-1-processing-n:127.0.0.1:36381_solr) [n:127.0.0.1:36381_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1410752 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration.
[junit4] 2> 1410767 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1410774 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 1410775 INFO (qtp1495329247-11401) [ ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1410775 WARN (qtp1495329247-11401) [ ] o.e.j.s.ServletHandler /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:457)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> ... 29 more
[junit4] 2> 1410778 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 1410809 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57908_solr
[junit4] 2> 1410814 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 1410814 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ConnectionManager Connected:true
[junit4] 2> 1410814 INFO (zkCallback-1943-thread-5-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1410818 INFO (zkCallback-1938-thread-1-processing-n:127.0.0.1:36381_solr) [n:127.0.0.1:36381_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1410838 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 1411893 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1411894 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55939/solr ready
[junit4] 2> 1411958 INFO (qtp1606336230-11421) [n:127.0.0.1:57908_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1411974 INFO (OverseerThreadFactory-3557-thread-1-processing-n:127.0.0.1:36381_solr) [n:127.0.0.1:36381_solr ] o.a.s.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 1412095 INFO (OverseerStateUpdate-98765002838638596-127.0.0.1:36381_solr-n_0000000000) [n:127.0.0.1:36381_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:57908/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1412319 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1412441 INFO (zkCallback-1943-thread-5-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1412441 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1413360 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1413411 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 1413516 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1413560 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 1413560 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57908.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1dcaea79
[junit4] 2> 1413560 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1413560 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_AB163D8AFF236488-001/tempDir-001/node1/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_AB163D8AFF236488-001/tempDir-001/node1/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 1413565 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=31.5283203125, floorSegmentMB=1.083984375, forceMergeDeletesPctAllowed=12.987634221022578, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1413686 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1413686 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1413688 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1413688 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1413689 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@d0bb5c8
[junit4] 2> 1413690 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4cbe9e34[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 1413709 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 1413717 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 1413788 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1413788 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 1413788 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580240077716455424
[junit4] 2> 1413789 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 1413789 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 1413789 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 1413789 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 1413790 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 1413803 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1413803 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1413803 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:57908/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 1413803 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1413803 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:57908/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 1413803 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1413804 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 1413813 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:57908/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 1413814 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 1413824 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 1413825 INFO (searcherExecutor-3562-thread-1-processing-n:127.0.0.1:57908_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@4cbe9e34[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1413943 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1413943 INFO (zkCallback-1943-thread-5-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1413987 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1414027 INFO (qtp1606336230-11417) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1709
[junit4] 2> 1414028 WARN (httpShardExecutor-3551-thread-1-processing-n:127.0.0.1:36381_solr [https:////127.0.0.1:57908//solr] https:////127.0.0.1:57908//solr) [n:127.0.0.1:36381_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1507070374403&s=RduNdP0o2r0UedcMxXDpN6gLERc="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:34 GMT
[junit4] 2> 1414072 INFO (qtp1606336230-11421) [n:127.0.0.1:57908_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1414184 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1414184 INFO (zkCallback-1943-thread-5-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1415074 INFO (qtp1606336230-11421) [n:127.0.0.1:57908_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3117
[junit4] 2> 1415079 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1507070374043&s=MEDWcQMvEH05UL4HJ4gaR+yjEII="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:34 GMT
[junit4] 2> 1415079 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 1415080 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 1415086 INFO (qtp1495329247-11408) [n:127.0.0.1:36381_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1415092 INFO (qtp1606336230-11413) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1415093 WARN (qtp1495329247-11408) [n:127.0.0.1:36381_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1507070377178&s=l+tljfZDt2b1Tzj/aHGze1n0dtQ="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:37 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:37 GMT
[junit4] 2> 1415093 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1507070377172&s=7b7QABcupuFpv7DWybQbZygxtGQ="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:37 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:37 GMT
[junit4] 2> 1415093 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1507070377178&s=l+tljfZDt2b1Tzj/aHGze1n0dtQ="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:37 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:37 GMT
[junit4] 2> 1415099 INFO (qtp1606336230-11410) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1415099 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1507070377184&s=Cw+MuWOCF4eWG03I5fDsulhDzqQ="; Path=/; Domain=127.0.0.1; Expires=Mar, 03-Tet-2017 22:39:37 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Mar, 03-Tet-2017 22:39:37 GMT
[junit4] 2> 1415099 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[AB163D8AFF236488]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 1415102 INFO (jetty-closer-1931-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5007a3fd{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1415103 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=901143553
[junit4] 2> 1415103 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1415104 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b5c3058: rootName = solr_57908, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@14a2ace1
[junit4] 2> 1415109 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1415109 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@23f40230: rootName = solr_57908, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@b5f7a43
[junit4] 2> 1415113 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1415113 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b3ae457: rootName = solr_57908, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@100b8f2c
[junit4] 2> 1415113 INFO (jetty-closer-1931-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6afb11e6{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1415114 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1383475513
[junit4] 2> 1415114 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1415114 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@bd3dbd1: rootName = solr_36381, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3ea6b2b4
[junit4] 2> 1415119 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1415119 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61287013: rootName = solr_36381, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@b5f7a43
[junit4] 2> 1415124 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1415124 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@50fc2411: rootName = solr_36381, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@100b8f2c
[junit4] 2> 1415125 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1415128 INFO (jetty-closer-1931-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98765002838638596-127.0.0.1:36381_solr-n_0000000000) closing
[junit4] 2> 1415128 INFO (OverseerStateUpdate-98765002838638596-127.0.0.1:36381_solr-n_0000000000) [n:127.0.0.1:36381_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36381_solr
[junit4] 2> 1415132 INFO (jetty-closer-1931-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1415134 INFO (coreCloseExecutor-3568-thread-1) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@3e81025d
[junit4] 2> 1415135 INFO (coreCloseExecutor-3568-thread-1) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=1048642141
[junit4] 2> 1415135 INFO (coreCloseExecutor-3568-thread-1) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@52ac86e8: rootName = solr_57908, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@2fcac903
[junit4] 2> 1415142 ERROR (Thread[Thread-1901,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:36381_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 1415144 INFO (zkCallback-1943-thread-5-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57908_solr
[junit4] 2> 1415148 INFO (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1415150 INFO (coreCloseExecutor-3568-thread-1) [n:127.0.0.1:57908_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=1048642141
[junit4] 2> 1415152 WARN (zkCallback-1943-thread-7-processing-n:127.0.0.1:57908_solr) [n:127.0.0.1:57908_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1415154 ERROR (Thread[Thread-1899,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:57908_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 1415160 INFO (jetty-closer-1931-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1b4096e7{/solr,null,UNAVAILABLE}
[junit4] 2> 1415161 INFO (jetty-closer-1931-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@26a6d61{/solr,null,UNAVAILABLE}
[junit4] 2> 1415164 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1415165 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55939 55939
[junit4] 2> 1417966 INFO (Thread-1876) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55939 55939
[junit4] 2> 1417971 WARN (Thread-1876) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 3 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/collections/forwardingCollection/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/overseer_elect/election/98765002838638596-127.0.0.1:36381_solr-n_0000000000
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 1418018 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[AB163D8AFF236488]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Oct 03, 2017 12:39:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 1430192 ERROR (jetty-launcher-1930-thread-2-EventThread) [n:127.0.0.1:36381_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.IllegalStateException: Client is not started
[junit4] 2> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
[junit4] 2> at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 1430198 WARN (jetty-launcher-1930-thread-2-EventThread) [n:127.0.0.1:36381_solr ] o.a.c.ConnectionState Session expired event received
[junit4] 2> 1430201 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 1431303 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 1432409 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 1433511 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 1434635 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 1435738 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 1436871 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 1437973 WARN (jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939)) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> Oct 03, 2017 12:40:00 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] 2> 1) Thread[id=11449, name=jetty-launcher-1930-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 2) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] 2> 3) Thread[id=11516, name=jetty-launcher-1930-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] 2> Oct 03, 2017 12:40:00 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=11449, name=jetty-launcher-1930-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 2) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 3) Thread[id=11516, name=jetty-launcher-1930-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 1438287 ERROR (jetty-launcher-1930-thread-2-EventThread) [n:127.0.0.1:36381_solr ] o.a.z.ClientCnxn Event thread exiting due to interruption
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchron
[...truncated too long message...]
nectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> Oct 03, 2017 12:40:03 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=18076, maxDocsPerChunk=5, blockSize=7), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=18076, blockSize=7)), sim=RandomSimilarity(queryNorm=false): {}, locale=sq-AL, timezone=Australia/Canberra
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_141 (64-bit)/cpus=3,threads=4,free=349350064,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [RequestLoggingTest, AliasIntegrationTest, SolrMetricManagerTest, DistributedFacetExistsSmallTest, TestHdfsBackupRestoreCore, CustomCollectionTest, ReplicationFactorTest, NoCacheHeaderTest, TestSubQueryTransformer, MoveReplicaHDFSTest, SolrIndexSplitterTest, PKIAuthenticationIntegrationTest, TestXIncludeConfig, TestCloudPivotFacet, DefaultValueUpdateProcessorTest, ClassificationUpdateProcessorFactoryTest, TestSolrConfigHandler, OverriddenZkACLAndCredentialsProvidersTest, RemoteQueryErrorTest, TestFunctionQuery, TestLFUCache, ConnectionReuseTest, BasicDistributedZkTest, SpellCheckCollatorWithCollapseTest, TestCursorMarkWithoutUniqueKey, TestCodecSupport, CdcrReplicationDistributedZkTest, TestSha256AuthenticationProvider, LargeFieldTest, URLClassifyProcessorTest, HdfsWriteToMultipleCollectionsTest, SliceStateTest, QueryElevationComponentTest, AddBlockUpdateTest, TestNamedUpdateProcessors, OutputWriterTest, TestTrieFacet, TestComplexPhraseLeadingWildcard, PathHierarchyTokenizerFactoryTest, UnloadDistributedZkTest, TestNonDefinedSimilarityFactory, TestRawTransformer, TestUtils, TestMultiValuedNumericRangeQuery, VersionInfoTest, CoreAdminHandlerTest, HighlighterTest, TestSweetSpotSimilarityFactory, TestExclusionRuleCollectionAccess, DistributedQueueTest, TestFieldCollectionResource, BlockCacheTest, ZkFailoverTest, TestCustomSort, MigrateRouteKeyTest, TestGraphMLResponseWriter, TestLMDirichletSimilarityFactory, TestLegacyField, TestGroupingSearch, CollectionsAPIAsyncDistributedZkTest, TestMaxTokenLenTokenizer, TestOmitPositions, TestDistribDocBasedVersion, ConcurrentDeleteAndCreateCollectionTest, ExplicitHLLTest, TestDistributedSearch, LeaderInitiatedRecoveryOnCommitTest, TestSolrConfigHandlerCloud, RuleEngineTest, TestQuerySenderListener, TestCollectionsAPIViaSolrCloudCluster, SyncSliceTest, UUIDUpdateProcessorFallbackTest, TestEmbeddedSolrServerSchemaAPI, RankQueryTest, TestSolrCloudSnapshots, AnalyticsQueryTest, ResponseLogComponentTest, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=AB163D8AFF236488 -Dtests.slow=true -Dtests.locale=sq-AL -Dtests.timezone=Australia/Canberra -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=11449, name=jetty-launcher-1930-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > 2) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 3) Thread[id=11516, name=jetty-launcher-1930-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] > at __randomizedtesting.SeedInfo.seed([AB163D8AFF236488]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=11515, name=jetty-launcher-1930-thread-2-SendThread(127.0.0.1:55939), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > at __randomizedtesting.SeedInfo.seed([AB163D8AFF236488]:0)
[junit4] Completed [169/733 (1!)] on J0 in 58.51s, 12 tests, 2 errors <<< FAILURES!
[...truncated 48290 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:826: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:101: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:669: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:682: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:2570: exec returned: 1
Total time: 72 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 221 -
Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/221/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
3 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Error from server at http://127.0.0.1:42829/solr/awhollynewcollection_0: {"awhollynewcollection_0":6}
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42829/solr/awhollynewcollection_0: {"awhollynewcollection_0":6}
at __randomizedtesting.SeedInfo.seed([322FC4B17481F353:7A5AB00572B2DCC6]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:460)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=33545, name=jetty-launcher-6647-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 2) Thread[id=33610, name=jetty-launcher-6647-thread-2-SendThread(127.0.0.1:35911), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1246) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1170) 3) Thread[id=33611, name=jetty-launcher-6647-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=33545, name=jetty-launcher-6647-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
2) Thread[id=33610, name=jetty-launcher-6647-thread-2-SendThread(127.0.0.1:35911), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1246)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1170)
3) Thread[id=33611, name=jetty-launcher-6647-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
at __randomizedtesting.SeedInfo.seed([322FC4B17481F353]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=33610, name=jetty-launcher-6647-thread-2-SendThread(127.0.0.1:35911), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=33610, name=jetty-launcher-6647-thread-2-SendThread(127.0.0.1:35911), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
at __randomizedtesting.SeedInfo.seed([322FC4B17481F353]:0)
Build Log:
[...truncated 12644 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 1672782 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/init-core-data-001
[junit4] 2> 1672782 WARN (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=48 numCloses=48
[junit4] 2> 1672782 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1672783 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1672784 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001
[junit4] 2> 1672784 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1672784 INFO (Thread-5133) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1672784 INFO (Thread-5133) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1672786 ERROR (Thread-5133) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1672894 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:44447
[junit4] 2> 1672901 INFO (jetty-launcher-2363-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1672902 INFO (jetty-launcher-2363-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1672903 INFO (jetty-launcher-2363-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1055838{/solr,null,AVAILABLE}
[junit4] 2> 1672903 INFO (jetty-launcher-2363-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1672903 INFO (jetty-launcher-2363-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2cc78b36{HTTP/1.1,[http/1.1]}{127.0.0.1:39768}
[junit4] 2> 1672903 INFO (jetty-launcher-2363-thread-2) [ ] o.e.j.s.Server Started @1675031ms
[junit4] 2> 1672903 INFO (jetty-launcher-2363-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39768}
[junit4] 2> 1672903 ERROR (jetty-launcher-2363-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1672904 INFO (jetty-launcher-2363-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1672904 INFO (jetty-launcher-2363-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1672904 INFO (jetty-launcher-2363-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1672904 INFO (jetty-launcher-2363-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T01:33:53.806Z
[junit4] 2> 1672906 INFO (jetty-launcher-2363-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1672907 INFO (jetty-launcher-2363-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8083fd7{/solr,null,AVAILABLE}
[junit4] 2> 1672908 INFO (jetty-launcher-2363-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2cb85d2a{HTTP/1.1,[http/1.1]}{127.0.0.1:48833}
[junit4] 2> 1672908 INFO (jetty-launcher-2363-thread-4) [ ] o.e.j.s.Server Started @1675036ms
[junit4] 2> 1672908 INFO (jetty-launcher-2363-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48833}
[junit4] 2> 1672908 ERROR (jetty-launcher-2363-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c6a480e{/solr,null,AVAILABLE}
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T01:33:53.811Z
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@76739c87{HTTP/1.1,[http/1.1]}{127.0.0.1:52054}
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-3) [ ] o.e.j.s.Server Started @1675037ms
[junit4] 2> 1672909 INFO (jetty-launcher-2363-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52054}
[junit4] 2> 1672909 ERROR (jetty-launcher-2363-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1672910 INFO (jetty-launcher-2363-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1672910 INFO (jetty-launcher-2363-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1672910 INFO (jetty-launcher-2363-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1672910 INFO (jetty-launcher-2363-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T01:33:53.812Z
[junit4] 2> 1672913 INFO (jetty-launcher-2363-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5fc7147c{/solr,null,AVAILABLE}
[junit4] 2> 1672913 INFO (jetty-launcher-2363-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3f309514{HTTP/1.1,[http/1.1]}{127.0.0.1:42829}
[junit4] 2> 1672915 INFO (jetty-launcher-2363-thread-1) [ ] o.e.j.s.Server Started @1675042ms
[junit4] 2> 1672915 INFO (jetty-launcher-2363-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42829}
[junit4] 2> 1672915 ERROR (jetty-launcher-2363-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1672915 INFO (jetty-launcher-2363-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1672915 INFO (jetty-launcher-2363-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1672915 INFO (jetty-launcher-2363-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1672915 INFO (jetty-launcher-2363-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T01:33:53.817Z
[junit4] 2> 1672917 INFO (jetty-launcher-2363-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1672918 INFO (jetty-launcher-2363-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1672919 INFO (jetty-launcher-2363-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1672923 INFO (jetty-launcher-2363-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1672928 INFO (jetty-launcher-2363-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44447/solr
[junit4] 2> 1672930 INFO (jetty-launcher-2363-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44447/solr
[junit4] 2> 1672937 INFO (jetty-launcher-2363-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44447/solr
[junit4] 2> 1672941 INFO (jetty-launcher-2363-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44447/solr
[junit4] 2> 1673141 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1673143 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42829_solr
[junit4] 2> 1673143 INFO (jetty-launcher-2363-thread-2) [n:127.0.0.1:39768_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1673144 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.c.Overseer Overseer (id=98762387206111244-127.0.0.1:42829_solr-n_0000000000) starting
[junit4] 2> 1673145 INFO (jetty-launcher-2363-thread-2) [n:127.0.0.1:39768_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39768_solr
[junit4] 2> 1673147 INFO (zkCallback-2385-thread-1-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1673147 INFO (zkCallback-2377-thread-1-processing-n:127.0.0.1:39768_solr) [n:127.0.0.1:39768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1673149 INFO (zkCallback-2383-thread-1-processing-n:127.0.0.1:48833_solr) [n:127.0.0.1:48833_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1673150 INFO (jetty-launcher-2363-thread-4) [n:127.0.0.1:48833_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1673155 INFO (jetty-launcher-2363-thread-4) [n:127.0.0.1:48833_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48833_solr
[junit4] 2> 1673156 INFO (zkCallback-2377-thread-1-processing-n:127.0.0.1:39768_solr) [n:127.0.0.1:39768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1673157 INFO (zkCallback-2383-thread-1-processing-n:127.0.0.1:48833_solr) [n:127.0.0.1:48833_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1673157 INFO (zkCallback-2385-thread-1-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1673165 INFO (jetty-launcher-2363-thread-3) [n:127.0.0.1:52054_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1673168 INFO (jetty-launcher-2363-thread-3) [n:127.0.0.1:52054_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1673171 INFO (jetty-launcher-2363-thread-3) [n:127.0.0.1:52054_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52054_solr
[junit4] 2> 1673173 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42829_solr
[junit4] 2> 1673175 INFO (zkCallback-2377-thread-1-processing-n:127.0.0.1:39768_solr) [n:127.0.0.1:39768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1673175 INFO (zkCallback-2383-thread-1-processing-n:127.0.0.1:48833_solr) [n:127.0.0.1:48833_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1673175 INFO (zkCallback-2380-thread-1-processing-n:127.0.0.1:52054_solr) [n:127.0.0.1:52054_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1673176 INFO (zkCallback-2385-thread-1-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1673177 INFO (zkCallback-2383-thread-1-processing-n:127.0.0.1:48833_solr) [n:127.0.0.1:48833_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1673177 INFO (zkCallback-2377-thread-1-processing-n:127.0.0.1:39768_solr) [n:127.0.0.1:39768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1673177 INFO (zkCallback-2385-thread-1-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1673180 INFO (zkCallback-2380-thread-1-processing-n:127.0.0.1:52054_solr) [n:127.0.0.1:52054_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1673238 INFO (jetty-launcher-2363-thread-2) [n:127.0.0.1:39768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673246 INFO (jetty-launcher-2363-thread-2) [n:127.0.0.1:39768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673246 INFO (jetty-launcher-2363-thread-2) [n:127.0.0.1:39768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673249 INFO (jetty-launcher-2363-thread-2) [n:127.0.0.1:39768_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node2
[junit4] 2> 1673261 INFO (jetty-launcher-2363-thread-4) [n:127.0.0.1:48833_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673269 INFO (jetty-launcher-2363-thread-4) [n:127.0.0.1:48833_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673269 INFO (jetty-launcher-2363-thread-4) [n:127.0.0.1:48833_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673276 INFO (jetty-launcher-2363-thread-4) [n:127.0.0.1:48833_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node3
[junit4] 2> 1673282 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673288 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673289 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673290 INFO (jetty-launcher-2363-thread-1) [n:127.0.0.1:42829_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node1
[junit4] 2> 1673300 INFO (jetty-launcher-2363-thread-3) [n:127.0.0.1:52054_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673308 INFO (jetty-launcher-2363-thread-3) [n:127.0.0.1:52054_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673308 INFO (jetty-launcher-2363-thread-3) [n:127.0.0.1:52054_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1673309 INFO (jetty-launcher-2363-thread-3) [n:127.0.0.1:52054_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node4
[junit4] 2> 1673391 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1673392 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[322FC4B17481F353]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44447/solr ready
[junit4] 2> 1673421 INFO (TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[322FC4B17481F353]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMissingNumShards
[junit4] 2> 1673422 INFO (TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[322FC4B17481F353]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1673425 INFO (qtp208527100-15652) [n:127.0.0.1:48833_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1673427 INFO (OverseerThreadFactory-5987-thread-1-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.CreateCollectionCmd Create collection acollection
[junit4] 2> 1673428 ERROR (OverseerThreadFactory-5987-thread-1-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: acollection operation: create failed:org.apache.solr.common.SolrException: numShards is a required param (when using CompositeId router).
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:117)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:228)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1673432 INFO (qtp208527100-15652) [n:127.0.0.1:48833_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&wt=javabin&version=2} status=400 QTime=6
[junit4] 2> 1673432 INFO (TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[322FC4B17481F353]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMissingNumShards
[junit4] 2> 1673454 INFO (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[322FC4B17481F353]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testZeroNumShards
[junit4] 2> 1673456 INFO (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[322FC4B17481F353]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1673458 INFO (qtp208527100-15653) [n:127.0.0.1:48833_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1673460 INFO (OverseerThreadFactory-5987-thread-2-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.CreateCollectionCmd Create collection acollection
[junit4] 2> 1673461 INFO (OverseerCollectionConfigSetProcessor-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1673461 ERROR (OverseerThreadFactory-5987-thread-2-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: acollection operation: create failed:org.apache.solr.common.SolrException: numShards must be > 0
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:132)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:228)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1673463 INFO (qtp208527100-15653) [n:127.0.0.1:48833_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2} status=400 QTime=5
[junit4] 2> 1673463 ERROR (OverseerCollectionConfigSetProcessor-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.OverseerTaskProcessor :org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000002
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1327)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:374)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:371)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:371)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:572)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskQueue.remove(OverseerTaskQueue.java:94)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor.cleanUpWorkQueue(OverseerTaskProcessor.java:321)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:202)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1673463 INFO (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[322FC4B17481F353]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testZeroNumShards
[junit4] 2> 1673464 INFO (OverseerCollectionConfigSetProcessor-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1673485 INFO (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[322FC4B17481F353]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCollectionsAPI
[junit4] 2> 1673486 INFO (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[322FC4B17481F353]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1673488 INFO (qtp208527100-15654) [n:127.0.0.1:48833_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=336bd2d3-2394-4a8f-98bc-14e0b07951ce&replicationFactor=1&collection.configName=conf2&maxShardsPerNode=2&name=awhollynewcollection_0&nrtReplicas=1&action=CREATE&numShards=5&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1673490 INFO (qtp208527100-15654) [n:127.0.0.1:48833_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=336bd2d3-2394-4a8f-98bc-14e0b07951ce&replicationFactor=1&collection.configName=conf2&maxShardsPerNode=2&name=awhollynewcollection_0&nrtReplicas=1&action=CREATE&numShards=5&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1673493 INFO (OverseerThreadFactory-5987-thread-3-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.CreateCollectionCmd Create collection awhollynewcollection_0
[junit4] 2> 1673504 INFO (zkCallback-2393-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673615 INFO (OverseerStateUpdate-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"awhollynewcollection_0",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"awhollynewcollection_0_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48833/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1673624 INFO (OverseerStateUpdate-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"awhollynewcollection_0",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"awhollynewcollection_0_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52054/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1673631 INFO (OverseerStateUpdate-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"awhollynewcollection_0",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"awhollynewcollection_0_shard3_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42829/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1673640 INFO (OverseerStateUpdate-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"awhollynewcollection_0",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"awhollynewcollection_0_shard4_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39768/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1673650 INFO (OverseerStateUpdate-98762387206111244-127.0.0.1:42829_solr-n_0000000000) [n:127.0.0.1:42829_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"awhollynewcollection_0",
[junit4] 2> "shard":"shard5",
[junit4] 2> "core":"awhollynewcollection_0_shard5_replica_n8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48833/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1673766 INFO (zkCallback-2393-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673850 INFO (qtp208527100-15655) [n:127.0.0.1:48833_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139&coreNodeName=core_node3&name=awhollynewcollection_0_shard1_replica_n1&action=CREATE&numShards=5&shard=shard1&wt=javabin} status=0 QTime=0
[junit4] 2> 1673851 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139&coreNodeName=core_node3&name=awhollynewcollection_0_shard1_replica_n1&action=CREATE&numShards=5&shard=shard1&wt=javabin
[junit4] 2> 1673851 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1673852 INFO (qtp208527100-15655) [n:127.0.0.1:48833_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291&coreNodeName=core_node10&name=awhollynewcollection_0_shard5_replica_n8&action=CREATE&numShards=5&shard=shard5&wt=javabin} status=0 QTime=0
[junit4] 2> 1673852 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291&coreNodeName=core_node10&name=awhollynewcollection_0_shard5_replica_n8&action=CREATE&numShards=5&shard=shard5&wt=javabin
[junit4] 2> 1673853 INFO (qtp1069280670-15635) [n:127.0.0.1:39768_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980&coreNodeName=core_node9&name=awhollynewcollection_0_shard4_replica_n6&action=CREATE&numShards=5&shard=shard4&wt=javabin} status=0 QTime=0
[junit4] 2> 1673853 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980&coreNodeName=core_node9&name=awhollynewcollection_0_shard4_replica_n6&action=CREATE&numShards=5&shard=shard4&wt=javabin
[junit4] 2> 1673853 INFO (qtp497258050-15644) [n:127.0.0.1:52054_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775&coreNodeName=core_node5&name=awhollynewcollection_0_shard2_replica_n2&action=CREATE&numShards=5&shard=shard2&wt=javabin} status=0 QTime=0
[junit4] 2> 1673853 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1673853 INFO (qtp173949774-15666) [n:127.0.0.1:42829_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318&coreNodeName=core_node7&name=awhollynewcollection_0_shard3_replica_n4&action=CREATE&numShards=5&shard=shard3&wt=javabin} status=0 QTime=0
[junit4] 2> 1673854 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318&coreNodeName=core_node7&name=awhollynewcollection_0_shard3_replica_n4&action=CREATE&numShards=5&shard=shard3&wt=javabin
[junit4] 2> 1673854 INFO (qtp173949774-15669) [n:127.0.0.1:42829_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318
[junit4] 2> 1673854 INFO (qtp173949774-15669) [n:127.0.0.1:42829_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1673854 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1673854 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775&coreNodeName=core_node5&name=awhollynewcollection_0_shard2_replica_n2&action=CREATE&numShards=5&shard=shard2&wt=javabin
[junit4] 2> 1673855 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1673978 INFO (zkCallback-2393-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673978 INFO (zkCallback-2377-thread-1-processing-n:127.0.0.1:39768_solr) [n:127.0.0.1:39768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673978 INFO (zkCallback-2377-thread-2-processing-n:127.0.0.1:39768_solr) [n:127.0.0.1:39768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673978 INFO (zkCallback-2380-thread-1-processing-n:127.0.0.1:52054_solr) [n:127.0.0.1:52054_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673979 INFO (zkCallback-2385-thread-2-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673979 INFO (zkCallback-2380-thread-2-processing-n:127.0.0.1:52054_solr) [n:127.0.0.1:52054_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673979 INFO (zkCallback-2385-thread-1-processing-n:127.0.0.1:42829_solr) [n:127.0.0.1:42829_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673979 INFO (zkCallback-2383-thread-1-processing-n:127.0.0.1:48833_solr) [n:127.0.0.1:48833_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1673979 INFO (zkCallback-2383-thread-2-processing-n:127.0.0.1:48833_solr) [n:127.0.0.1:48833_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1674857 INFO (qtp173949774-15669) [n:127.0.0.1:42829_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318
[junit4] 2> 1674857 INFO (qtp173949774-15669) [n:127.0.0.1:42829_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1674870 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1674870 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1674872 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1674876 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.s.IndexSchema [awhollynewcollection_0_shard3_replica_n4] Schema name=minimal
[junit4] 2> 1674878 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.s.IndexSchema [awhollynewcollection_0_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1674878 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1674878 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard3_replica_n4' using configuration from collection awhollynewcollection_0, trusted=true
[junit4] 2> 1674879 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard3.replica_n4' (registry 'solr.core.awhollynewcollection_0.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1674879 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1674879 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.SolrCore [[awhollynewcollection_0_shard3_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node1/awhollynewcollection_0_shard3_replica_n4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node1/awhollynewcollection_0_shard3_replica_n4/data/]
[junit4] 2> 1674880 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1674880 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard2_replica_n2' using configuration from collection awhollynewcollection_0, trusted=true
[junit4] 2> 1674880 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard2.replica_n2' (registry 'solr.core.awhollynewcollection_0.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1674880 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1674880 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.SolrCore [[awhollynewcollection_0_shard2_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node4/awhollynewcollection_0_shard2_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node4/awhollynewcollection_0_shard2_replica_n2/data/]
[junit4] 2> 1674886 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.s.IndexSchema [awhollynewcollection_0_shard4_replica_n6] Schema name=minimal
[junit4] 2> 1674887 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1674887 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard4_replica_n6' using configuration from collection awhollynewcollection_0, trusted=true
[junit4] 2> 1674887 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard4.replica_n6' (registry 'solr.core.awhollynewcollection_0.shard4.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1674888 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1674888 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.c.SolrCore [[awhollynewcollection_0_shard4_replica_n6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node2/awhollynewcollection_0_shard4_replica_n6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node2/awhollynewcollection_0_shard4_replica_n6/data/]
[junit4] 2> 1674903 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1674903 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard1 r:core_node3 x:awhollynewcollection_0_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1674908 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard1 r:core_node3 x:awhollynewcollection_0_shard1_replica_n1] o.a.s.s.IndexSchema [awhollynewcollection_0_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1674908 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.s.IndexSchema [awhollynewcollection_0_shard5_replica_n8] Schema name=minimal
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard1 r:core_node3 x:awhollynewcollection_0_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard5_replica_n8' using configuration from collection awhollynewcollection_0, trusted=true
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard1 r:core_node3 x:awhollynewcollection_0_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard1_replica_n1' using configuration from collection awhollynewcollection_0, trusted=true
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard1 r:core_node3 x:awhollynewcollection_0_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard1.replica_n1' (registry 'solr.core.awhollynewcollection_0.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard5.replica_n8' (registry 'solr.core.awhollynewcollection_0.shard5.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43d9117b
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard1 r:core_node3 x:awhollynewcollection_0_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1674910 INFO (parallelCoreAdminExecutor-5988-thread-1-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086284049139 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard1 r:core_node3 x:awhollynewcollection_0_shard1_replica_n1] o.a.s.c.SolrCore [[awhollynewcollection_0_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node3/awhollynewcollection_0_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node3/awhollynewcollection_0_shard1_replica_n1/data/]
[junit4] 2> 1674911 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.c.SolrCore [[awhollynewcollection_0_shard5_replica_n8] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node3/awhollynewcollection_0_shard5_replica_n8], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_322FC4B17481F353-001/tempDir-001/node3/awhollynewcollection_0_shard5_replica_n8/data/]
[junit4] 2> 1674931 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1674931 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1674932 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1674932 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1674933 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@4e3016f5[awhollynewcollection_0_shard3_replica_n4] main]
[junit4] 2> 1674936 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
[junit4] 2> 1674936 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
[junit4] 2> 1674936 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1674937 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580198197554315264
[junit4] 2> 1674938 INFO (searcherExecutor-5996-thread-1-processing-x:awhollynewcollection_0_shard3_replica_n4 r:core_node7 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE n:127.0.0.1:42829_solr s:shard3 c:awhollynewcollection_0) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.SolrCore [awhollynewcollection_0_shard3_replica_n4] Registered new searcher Searcher@4e3016f5[awhollynewcollection_0_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1674948 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1674948 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1674948 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42829/solr/awhollynewcollection_0_shard3_replica_n4/
[junit4] 2> 1674948 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1674948 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.SyncStrategy http://127.0.0.1:42829/solr/awhollynewcollection_0_shard3_replica_n4/ has no replicas
[junit4] 2> 1674948 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1674955 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1674955 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1674955 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1674956 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1674956 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@544053b0[awhollynewcollection_0_shard2_replica_n2] main]
[junit4] 2> 1674957 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
[junit4] 2> 1674958 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
[junit4] 2> 1674958 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1674958 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580198197576335360
[junit4] 2> 1674962 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1674962 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:52054/solr/awhollynewcollection_0_shard2_replica_n2/
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:52054/solr/awhollynewcollection_0_shard2_replica_n2/ has no replicas
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1674963 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1674964 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1674964 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1674964 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.s.SolrIndexSearcher Opening [Searcher@7524e755[awhollynewcollection_0_shard5_replica_n8] main]
[junit4] 2> 1674964 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1674964 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1674965 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@7176906[awhollynewcollection_0_shard4_replica_n6] main]
[junit4] 2> 1674966 INFO (parallelCoreAdminExecutor-5993-thread-1-processing-n:127.0.0.1:52054_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:52054/solr/awhollynewcollection_0_shard2_replica_n2/ shard2
[junit4] 2> 1674967 INFO (searcherExecutor-5997-thread-1-processing-x:awhollynewcollection_0_shard2_replica_n2 r:core_node5 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086292185775 CREATE n:127.0.0.1:52054_solr s:shard2 c:awhollynewcollection_0) [n:127.0.0.1:52054_solr c:awhollynewcollection_0 s:shard2 r:core_node5 x:awhollynewcollection_0_shard2_replica_n2] o.a.s.c.SolrCore [awhollynewcollection_0_shard2_replica_n2] Registered new searcher Searcher@544053b0[awhollynewcollection_0_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1674967 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
[junit4] 2> 1674968 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
[junit4] 2> 1674968 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
[junit4] 2> 1674968 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1674968 INFO (parallelCoreAdminExecutor-5989-thread-1-processing-n:127.0.0.1:39768_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580198197586821120
[junit4] 2> 1674970 INFO (searcherExecutor-5998-thread-1-processing-x:awhollynewcollection_0_shard4_replica_n6 r:core_node9 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086307737980 CREATE n:127.0.0.1:39768_solr s:shard4 c:awhollynewcollection_0) [n:127.0.0.1:39768_solr c:awhollynewcollection_0 s:shard4 r:core_node9 x:awhollynewcollection_0_shard4_replica_n6] o.a.s.c.SolrCore [awhollynewcollection_0_shard4_replica_n6] Registered new searcher Searcher@7176906[awhollynewcollection_0_shard4_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1674971 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
[junit4] 2> 1674971 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1674971 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580198197589966848
[junit4] 2> 1674972 INFO (parallelCoreAdminExecutor-5990-thread-1-processing-n:127.0.0.1:42829_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086299054318 CREATE) [n:127.0.0.1:42829_solr c:awhollynewcollection_0 s:shard3 r:core_node7 x:awhollynewcollection_0_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42829/solr/awhollynewcollection_0_shard3_replica_n4/ shard3
[junit4] 2> 1674973 INFO (searcherExecutor-5999-thread-1-processing-x:awhollynewcollection_0_shard5_replica_n8 r:core_node10 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE n:127.0.0.1:48833_solr s:shard5 c:awhollynewcollection_0) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.c.SolrCore [awhollynewcollection_0_shard5_replica_n8] Registered new searcher Searcher@7524e755[awhollynewcollection_0_shard5_replica_n8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1674977 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1172086313577291 CREATE) [n:127.0.0.1:48833_solr c:awhollynewcollection_0 s:shard5 r:core_node10 x:awhollynewcollection_0_shard5_replica_n8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1674977 INFO (parallelCoreAdminExecutor-5988-thread-2-processing-n:127.0.0.1:48833_solr 336bd2d3-2394-4a8f-98bc-14e0b07951ce1
[...truncated too long message...]
stBinaryField, SparseHLLTest, TestDistributedSearch, SolrCoreTest, HLLSerializationTest, OverseerModifyCollectionTest, SortByFunctionTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, PeerSyncTest, V2StandaloneTest, SolrTestCaseJ4Test, TriLevelCompositeIdRoutingTest, CollectionsAPIAsyncDistributedZkTest, DirectUpdateHandlerTest, TestOnReconnectListenerSupport, TestStressRecovery, TestIntervalFaceting, RecoveryZkTest, TestCollectionsAPIViaSolrCloudCluster, CachingDirectoryFactoryTest, SimplePostToolTest, TestRequestForwarding, TestPullReplica, UnloadDistributedZkTest, OverseerStatusTest, SolrMetricsIntegrationTest, TestRTimerTree, BlobRepositoryCloudTest, SolrCloudExampleTest, TestJsonFacets, TestConfigOverlay, TestFieldCacheVsDocValues, UniqFieldsUpdateProcessorFactoryTest, HdfsWriteToMultipleCollectionsTest, OutputWriterTest, TestWriterPerf, ResponseLogComponentTest, TestCloudInspectUtil, TestScoreJoinQPScore, TestLegacyNumericRangeQueryBuilder, TestSubQueryTransformer, TestRecoveryHdfs, TestPushWriter, AnalysisAfterCoreReloadTest, RequestLoggingTest, UUIDFieldTest, TestDistribDocBasedVersion, ZkSolrClientTest, ZkCLITest, ShardRoutingCustomTest, TestDistributedGrouping, TestFaceting, TermVectorComponentDistributedTest, ZkControllerTest, SpellCheckComponentTest, TestGroupingSearch, QueryElevationComponentTest, TestLazyCores, ShowFileRequestHandlerTest, SpellCheckCollatorTest, CoreAdminHandlerTest, SolrRequestParserTest, SuggesterTSTTest, SuggesterTest, TestTrie, SpatialFilterTest, TestWordDelimiterFilterFactory, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, DocValuesMultiTest, XsltUpdateRequestHandlerTest, DebugComponentTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, TestOmitPositions, TermsComponentTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, TestValueSourceCache, TermVectorComponentTest, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, SolrPluginUtilsTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, SearchHandlerTest, TestCharFilters, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TimeZoneUtilsTest, ScriptEngineTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, RAMDirectoryFactoryTest, TestSolrJ, TestDocumentBuilder, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestHighlightDedupGrouping, TestLuceneIndexBackCompat, ActionThrottleTest, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, ChaosMonkeySafeLeaderWithPullReplicasTest, ConnectionManagerTest, DeleteInactiveReplicaTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DistribCursorPagingTest, DistributedQueueTest, DistributedVersionInfoTest, LeaderElectionContextKeyTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MultiThreadedOCPTest, ReplaceNodeTest, ReplicationFactorTest, RollingRestartTest, SharedFSAutoReplicaFailoverTest, SimpleCollectionCreateDeleteTest, TestAuthenticationFramework, TestCloudDeleteByQuery, TestCloudPseudoReturnFields, TestConfigSetsAPI, TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestDeleteCollectionOnDownNodes, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestLeaderElectionWithEmptyReplica, TestLeaderInitiatedRecoveryThread, TestLocalFSCloudBackupRestore, TestMiniSolrCloudClusterSSL, TestReplicaProperties, TestRequestStatusCollectionAPI, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=322FC4B17481F353 -Dtests.slow=true -Dtests.locale=en-IN -Dtests.timezone=Pacific/Yap -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=33545, name=jetty-launcher-6647-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > 2) Thread[id=33610, name=jetty-launcher-6647-thread-2-SendThread(127.0.0.1:35911), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1246)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1170)
[junit4] > 3) Thread[id=33611, name=jetty-launcher-6647-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] > at __randomizedtesting.SeedInfo.seed([322FC4B17481F353]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=33610, name=jetty-launcher-6647-thread-2-SendThread(127.0.0.1:35911), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > at __randomizedtesting.SeedInfo.seed([322FC4B17481F353]:0)
[junit4] Completed [552/733 (2!)] on J0 in 60.50s, 12 tests, 2 errors <<< FAILURES!
[...truncated 47119 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:826: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/build.xml:101: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:669: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build.xml:682: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:2570: exec returned: 1
Total time: 84 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any