You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/11/03 05:04:38 UTC
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build #
1508 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1508/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.TestAuthenticationFramework.testBasics
Error Message:
Error from server at http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([85D9181FA30EA2A4:B801B6339BE0FCD4]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:541)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1008)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:518)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Build Log:
[...truncated 13302 lines...]
[junit4] Suite: org.apache.solr.cloud.TestAuthenticationFramework
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/init-core-data-001
[junit4] 2> 2677098 WARN (SUITE-TestAuthenticationFramework-seed#[85D9181FA30EA2A4]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 2677098 INFO (SUITE-TestAuthenticationFramework-seed#[85D9181FA30EA2A4]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2677100 INFO (SUITE-TestAuthenticationFramework-seed#[85D9181FA30EA2A4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2677100 INFO (SUITE-TestAuthenticationFramework-seed#[85D9181FA30EA2A4]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2677103 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001
[junit4] 2> 2677103 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2677104 INFO (Thread-5051) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2677104 INFO (Thread-5051) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2677106 ERROR (Thread-5051) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2677203 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.c.ZkTestServer start zk server on port:56108
[junit4] 2> 2677212 INFO (jetty-launcher-3642-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2677213 INFO (jetty-launcher-3642-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2677214 INFO (jetty-launcher-3642-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ed4ae8b{/solr,null,AVAILABLE}
[junit4] 2> 2677215 INFO (jetty-launcher-3642-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@62f0bae{HTTP/1.1,[http/1.1]}{127.0.0.1:43368}
[junit4] 2> 2677215 INFO (jetty-launcher-3642-thread-2) [ ] o.e.j.s.Server Started @2679848ms
[junit4] 2> 2677215 INFO (jetty-launcher-3642-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43368}
[junit4] 2> 2677215 ERROR (jetty-launcher-3642-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2677215 INFO (jetty-launcher-3642-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2677215 INFO (jetty-launcher-3642-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2677215 INFO (jetty-launcher-3642-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2677215 INFO (jetty-launcher-3642-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T04:18:13.404Z
[junit4] 2> 2677218 INFO (jetty-launcher-3642-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28f88ae1{/solr,null,AVAILABLE}
[junit4] 2> 2677218 INFO (jetty-launcher-3642-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@29e57a55{HTTP/1.1,[http/1.1]}{127.0.0.1:33258}
[junit4] 2> 2677218 INFO (jetty-launcher-3642-thread-1) [ ] o.e.j.s.Server Started @2679852ms
[junit4] 2> 2677218 INFO (jetty-launcher-3642-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33258}
[junit4] 2> 2677218 ERROR (jetty-launcher-3642-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2677219 INFO (jetty-launcher-3642-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2677219 INFO (jetty-launcher-3642-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2677219 INFO (jetty-launcher-3642-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2677219 INFO (jetty-launcher-3642-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T04:18:13.408Z
[junit4] 2> 2677222 INFO (jetty-launcher-3642-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2677224 INFO (jetty-launcher-3642-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2677239 INFO (jetty-launcher-3642-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56108/solr
[junit4] 2> 2677253 INFO (jetty-launcher-3642-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56108/solr
[junit4] 2> 2677365 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2677366 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43368_solr
[junit4] 2> 2677368 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.c.Overseer Overseer (id=98938564987781126-127.0.0.1:43368_solr-n_0000000000) starting
[junit4] 2> 2677394 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43368_solr
[junit4] 2> 2677471 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 2677471 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2677475 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2677478 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33258_solr
[junit4] 2> 2677535 INFO (zkCallback-3650-thread-1-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2677536 INFO (OverseerStateUpdate-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2677536 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43368.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2677542 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 2677547 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43368.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2677547 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43368.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2677548 INFO (jetty-launcher-3642-thread-2) [n:127.0.0.1:43368_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node1/.
[junit4] 2> 2677588 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33258.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2677600 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33258.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2677600 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33258.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2677602 INFO (jetty-launcher-3642-thread-1) [n:127.0.0.1:33258_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node2/.
[junit4] 2> 2677638 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f8019c4af0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2677648 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2677649 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:56108/solr ready
[junit4] 2> 2677655 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBasics
[junit4] 2> 2677658 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=2&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2677661 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=2&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 2677662 INFO (qtp900834817-21918) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2677665 INFO (qtp900834817-21918) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 2677666 INFO (OverseerThreadFactory-9715-thread-1-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.CreateCollectionCmd Create collection testcollection
[junit4] 2> 2677781 INFO (OverseerStateUpdate-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testcollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33258/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2677794 INFO (OverseerStateUpdate-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testcollection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43368/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2677800 INFO (OverseerStateUpdate-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testcollection_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33258/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2677806 INFO (OverseerStateUpdate-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testcollection_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43368/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2678041 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088&coreNodeName=core_node8&name=testcollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=0
[junit4] 2> 2678042 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518&coreNodeName=core_node3&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=0
[junit4] 2> 2678042 INFO (qtp966123186-21907) [n:127.0.0.1:43368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336&coreNodeName=core_node5&name=testcollection_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=0
[junit4] 2> 2678042 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518&coreNodeName=core_node3&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 2678042 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088&coreNodeName=core_node8&name=testcollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 2678043 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2678043 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2678043 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336&coreNodeName=core_node5&name=testcollection_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 2678043 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050&coreNodeName=core_node7&name=testcollection_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=0
[junit4] 2> 2678044 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050&coreNodeName=core_node7&name=testcollection_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 2678045 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050
[junit4] 2> 2678045 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2678165 INFO (zkCallback-3650-thread-1-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2678165 INFO (zkCallback-3650-thread-2-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2678165 INFO (zkCallback-3654-thread-2-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2678165 INFO (zkCallback-3654-thread-1-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2678668 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2678670 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 2679048 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050
[junit4] 2> 2679048 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2679077 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2679082 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2679084 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2679088 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.s.IndexSchema [testcollection_shard1_replica_n2] Schema name=minimal
[junit4] 2> 2679089 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2679091 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2679091 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n2' using configuration from collection testcollection, trusted=true
[junit4] 2> 2679092 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43368.solr.core.testcollection.shard1.replica_n2' (registry 'solr.core.testcollection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2679092 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2679092 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrCore [[testcollection_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node1/testcollection_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node1/./testcollection_shard1_replica_n2/data/]
[junit4] 2> 2679095 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.s.IndexSchema [testcollection_shard2_replica_n4] Schema name=minimal
[junit4] 2> 2679096 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.s.IndexSchema [testcollection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2679097 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2679097 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n4' using configuration from collection testcollection, trusted=true
[junit4] 2> 2679098 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33258.solr.core.testcollection.shard2.replica_n4' (registry 'solr.core.testcollection.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2679098 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2679098 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrCore [[testcollection_shard2_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node2/testcollection_shard2_replica_n4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node2/./testcollection_shard2_replica_n4/data/]
[junit4] 2> 2679099 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2679099 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n1' using configuration from collection testcollection, trusted=true
[junit4] 2> 2679099 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33258.solr.core.testcollection.shard1.replica_n1' (registry 'solr.core.testcollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2679099 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2679099 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [[testcollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node2/testcollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node2/./testcollection_shard1_replica_n1/data/]
[junit4] 2> 2679111 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.s.IndexSchema [testcollection_shard2_replica_n6] Schema name=minimal
[junit4] 2> 2679115 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2679115 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n6' using configuration from collection testcollection, trusted=true
[junit4] 2> 2679116 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43368.solr.core.testcollection.shard2.replica_n6' (registry 'solr.core.testcollection.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@55c2268f
[junit4] 2> 2679116 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2679116 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrCore [[testcollection_shard2_replica_n6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node1/testcollection_shard2_replica_n6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001/tempDir-001/node1/./testcollection_shard2_replica_n6/data/]
[junit4] 2> 2679208 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2679209 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2679210 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2679210 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2679210 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2679210 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2679211 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2679211 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2679212 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b552a2b[testcollection_shard1_replica_n2] main]
[junit4] 2> 2679212 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2d87f9c8[testcollection_shard1_replica_n1] main]
[junit4] 2> 2679214 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2679215 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2679215 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2679216 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2679216 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583017042016993280
[junit4] 2> 2679216 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2679249 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2679249 INFO (parallelCoreAdminExecutor-9718-thread-1-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583017042051596288
[junit4] 2> 2679249 INFO (searcherExecutor-9720-thread-1-processing-x:testcollection_shard1_replica_n2 r:core_node5 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE n:127.0.0.1:43368_solr s:shard1 c:testcollection) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrCore [testcollection_shard1_replica_n2] Registered new searcher Searcher@5b552a2b[testcollection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2679255 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2679255 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2679256 INFO (searcherExecutor-9722-thread-1-processing-x:testcollection_shard1_replica_n1 r:core_node3 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414955446518 CREATE n:127.0.0.1:33258_solr s:shard1 c:testcollection) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] Registered new searcher Searcher@2d87f9c8[testcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2679256 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2679256 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2679258 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@15f08ef3[testcollection_shard2_replica_n6] main]
[junit4] 2> 2679258 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 2679260 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2679261 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2679261 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2679262 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583017042065227776
[junit4] 2> 2679263 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2679263 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2679264 INFO (searcherExecutor-9723-thread-1-processing-x:testcollection_shard2_replica_n6 r:core_node8 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE n:127.0.0.1:43368_solr s:shard2 c:testcollection) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrCore [testcollection_shard2_replica_n6] Registered new searcher Searcher@15f08ef3[testcollection_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2679265 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2679265 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2679267 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@61e34f4c[testcollection_shard2_replica_n4] main]
[junit4] 2> 2679270 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2679271 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2679272 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2679272 INFO (parallelCoreAdminExecutor-9718-thread-2-processing-n:127.0.0.1:33258_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583017042075713536
[junit4] 2> 2679274 INFO (searcherExecutor-9721-thread-1-processing-x:testcollection_shard2_replica_n4 r:core_node7 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050 CREATE n:127.0.0.1:33258_solr s:shard2 c:testcollection) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrCore [testcollection_shard2_replica_n4] Registered new searcher Searcher@61e34f4c[testcollection_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2679274 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9998ms
[junit4] 2> 2679374 INFO (zkCallback-3654-thread-2-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2679374 INFO (zkCallback-3654-thread-1-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2679374 INFO (zkCallback-3650-thread-1-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2679374 INFO (zkCallback-3650-thread-2-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2679676 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2679677 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 2679760 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2679760 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2679760 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/
[junit4] 2> 2679761 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testcollection_shard1_replica_n2 url=http://127.0.0.1:43368/solr START replicas=[http://127.0.0.1:33258/solr/testcollection_shard1_replica_n1/] nUpdates=100
[junit4] 2> 2679763 INFO (qtp900834817-21922) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.S.Request [testcollection_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2679780 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2679780 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2679781 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43368/solr/testcollection_shard2_replica_n6/
[junit4] 2> 2679781 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=testcollection_shard2_replica_n6 url=http://127.0.0.1:43368/solr START replicas=[http://127.0.0.1:33258/solr/testcollection_shard2_replica_n4/] nUpdates=100
[junit4] 2> 2679782 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.S.Request [testcollection_shard2_replica_n4] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2680051 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050
[junit4] 2> 2680051 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2680064 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testcollection_shard1_replica_n2 url=http://127.0.0.1:43368/solr DONE. We have no versions. sync failed.
[junit4] 2> 2680064 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2680064 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2680064 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2680069 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/ shard1
[junit4] 2> 2680081 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=testcollection_shard2_replica_n6 url=http://127.0.0.1:43368/solr DONE. We have no versions. sync failed.
[junit4] 2> 2680081 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2680081 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2680082 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2680087 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43368/solr/testcollection_shard2_replica_n6/ shard2
[junit4] 2> 2680189 INFO (zkCallback-3650-thread-1-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680189 INFO (zkCallback-3654-thread-3-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680189 INFO (zkCallback-3650-thread-2-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680189 INFO (zkCallback-3654-thread-1-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680234 INFO (parallelCoreAdminExecutor-9716-thread-2-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414961275336 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2680239 INFO (parallelCoreAdminExecutor-9716-thread-1-processing-n:127.0.0.1:43368_solr 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088 CREATE) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2680398 INFO (zkCallback-3654-thread-3-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680398 INFO (zkCallback-3650-thread-2-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680398 INFO (zkCallback-3654-thread-2-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680398 INFO (zkCallback-3650-thread-1-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2680680 INFO (qtp900834817-21918) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2680682 INFO (qtp900834817-21918) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 2681053 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050
[junit4] 2> 2681053 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414974306050&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2681056 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088
[junit4] 2> 2681057 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd1012414980515088&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2681061 INFO (OverseerThreadFactory-9715-thread-1-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2681679 INFO (OverseerCollectionConfigSetProcessor-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2681684 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2681686 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 2681687 INFO (qtp900834817-21917) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2681688 INFO (qtp900834817-21917) [n:127.0.0.1:33258_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7e3bbd88-2500-4d93-b7c7-8b08c4359dbd&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2681688 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: testcollection failOnTimeout:true timeout (sec):330
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:active live:true
[junit4] 1> replica:core_node5 rstate:active live:true
[junit4] 1> replica:core_node7 rstate:active live:true
[junit4] 1> replica:core_node8 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 2> 2681689 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[85D9181FA30EA2A4]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: testcollection
[junit4] 2> 2681692 INFO (qtp966123186-21909) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.S.Request [testcollection_shard2_replica_n6] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:5&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:43368/solr/testcollection_shard2_replica_n6/|http://127.0.0.1:33258/solr/testcollection_shard2_replica_n4/&rows=10&version=2&q=*:*&NOW=1509682697880&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 2681693 INFO (qtp966123186-21904) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.S.Request [testcollection_shard1_replica_n2] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:5&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/|http://127.0.0.1:33258/solr/testcollection_shard1_replica_n1/&rows=10&version=2&q=*:*&NOW=1509682697880&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 2681693 INFO (qtp966123186-21911) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.S.Request [testcollection_shard1_replica_n2] webapp=/solr path=/select params={q=*:*&_stateVer_=testcollection:5&wt=javabin&version=2} hits=0 status=0 QTime=2
[junit4] 2> 2681700 INFO (qtp900834817-21922) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/&wt=javabin&version=2}{add=[1 (1583017044617461760)]} 0 1
[junit4] 2> 2681700 INFO (qtp966123186-21907) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n2] webapp=/solr path=/update params={_stateVer_=testcollection:5&wt=javabin&version=2}{add=[1 (1583017044617461760)]} 0 4
[junit4] 2> 2681707 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1583017044628996096,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2681708 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7268f0ee commitCommandVersion:1583017044628996096
[junit4] 2> 2681711 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1583017044633190400,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2681711 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6ba875de commitCommandVersion:1583017044633190400
[junit4] 2> 2681713 INFO (qtp966123186-21905) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1583017044635287552,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2681713 INFO (qtp966123186-21905) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2681714 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1583017044636336128,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2681714 INFO (qtp966123186-21905) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2681714 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@79bd46bf[testcollection_shard1_replica_n2] main]
[junit4] 2> 2681714 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2681714 INFO (qtp966123186-21905) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard2_replica_n6] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 2681714 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2681714 INFO (qtp900834817-21916) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard2_replica_n4] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 2681714 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2681717 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4d0b4c1b[testcollection_shard1_replica_n1] main]
[junit4] 2> 2681717 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2681717 INFO (searcherExecutor-9720-thread-1-processing-n:127.0.0.1:43368_solr x:testcollection_shard1_replica_n2 s:shard1 c:testcollection r:core_node5) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrCore [testcollection_shard1_replica_n2] Registered new searcher Searcher@79bd46bf[testcollection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 2681718 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 10
[junit4] 2> 2681719 INFO (searcherExecutor-9722-thread-1-processing-n:127.0.0.1:33258_solr x:testcollection_shard1_replica_n1 s:shard1 c:testcollection r:core_node3) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] Registered new searcher Searcher@4d0b4c1b[testcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 2681719 INFO (qtp900834817-21921) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 8
[junit4] 2> 2681719 INFO (qtp966123186-21908) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n2] webapp=/solr path=/update params={_stateVer_=testcollection:5&commit=true&wt=javabin&version=2}{commit=} 0 17
[junit4] 2> 2681723 INFO (qtp966123186-21911) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.S.Request [testcollection_shard1_replica_n2] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:5&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/|http://127.0.0.1:33258/solr/testcollection_shard1_replica_n1/&rows=10&version=2&q=*:*&NOW=1509682697909&isShard=true&wt=javabin} hits=1 status=0 QTime=0
[junit4] 2> 2681723 INFO (qtp966123186-21904) [n:127.0.0.1:43368_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.S.Request [testcollection_shard2_replica_n6] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:5&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:43368/solr/testcollection_shard2_replica_n6/|http://127.0.0.1:33258/solr/testcollection_shard2_replica_n4/&rows=10&version=2&q=*:*&NOW=1509682697909&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 2681724 INFO (qtp966123186-21907) [n:127.0.0.1:43368_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.S.Request [testcollection_shard1_replica_n2] webapp=/solr path=/select params={q=*:*&df=text&distrib=false&_stateVer_=testcollection:5&shards.purpose=64&NOW=1509682697909&ids=1&isShard=true&shard.url=http://127.0.0.1:43368/solr/testcollection_shard1_replica_n2/|http://127.0.0.1:33258/solr/testcollection_shard1_replica_n1/&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2681725 INFO (qtp900834817-21918) [n:127.0.0.1:33258_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.S.Request [testcollection_shard2_replica_n4] webapp=/solr path=/select params={q=*:*&_stateVer_=testcollection:5&wt=javabin&version=2} hits=1 status=0 QTime=4
[junit4] 2> 2681725 INFO (qtp900834817-21915) [n:127.0.0.1:33258_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testcollection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2681730 INFO (OverseerThreadFactory-9715-thread-2-processing-n:127.0.0.1:43368_solr) [n:127.0.0.1:43368_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 2681731 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard1.replica_n1, tag=null
[junit4] 2> 2681731 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@46d96d0e: rootName = solr_33258, domain = solr.core.testcollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testcollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@7d8948a0
[junit4] 2> 2681731 INFO (qtp966123186-21909) [n:127.0.0.1:43368_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard2.replica_n6, tag=null
[junit4] 2> 2681731 INFO (qtp966123186-21909) [n:127.0.0.1:43368_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@392ce888: rootName = solr_43368, domain = solr.core.testcollection.shard2.replica_n6, service url = null, agent id = null] for registry solr.core.testcollection.shard2.replica_n6 / com.codahale.metrics.MetricRegistry@688e4bf4
[junit4] 2> 2681747 INFO (qtp900834817-21917) [n:127.0.0.1:33258_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard2.replica_n4, tag=null
[junit4] 2> 2681747 INFO (qtp900834817-21917) [n:127.0.0.1:33258_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e87ec54: rootName = solr_33258, domain = solr.core.testcollection.shard2.replica_n4, service url = null, agent id = null] for registry solr.core.testcollection.shard2.replica_n4 / com.codahale.metrics.MetricRegistry@230e1bc3
[junit4] 2> 2681747 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@77d827c4
[junit4] 2> 2681748 INFO (qtp966123186-21909) [n:127.0.0.1:43368_solr ] o.a.s.c.SolrCore [testcollection_shard2_replica_n6] CLOSING SolrCore org.apache.solr.core.SolrCore@38585742
[junit4] 2> 2681748 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard1.replica_n2, tag=null
[junit4] 2> 2681748 INFO (qtp966123186-21910) [n:127.0.0.1:43368_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6b07b93: rootName = solr_43368, domain = solr.core.testcollection.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testcollection.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@4dbce7b1
[junit4] 2> 2681768 INFO (qtp900834817-21917) [n:127.0.0.1:33258_solr ] o.a.s.c.SolrCore [testcollection_shard2_replica_n4] CLOSING SolrCore org.apache.solr.core.SolrCore@aaf657c
[junit4] 2> 2681768 INFO (qtp900834817-21919) [n:127.0.0.1:33258_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard1.replica_n1, tag=2010654660
[juni
[...truncated too long message...]
n s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=1843285885
[junit4] 2> 2686279 INFO (coreCloseExecutor-9760-thread-2) [n:127.0.0.1:33258_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=84648327
[junit4] 2> 2686282 INFO (jetty-closer-3643-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98938564987781126-127.0.0.1:43368_solr-n_0000000000) closing
[junit4] 2> 2686283 INFO (OverseerStateUpdate-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43368_solr
[junit4] 2> 2686287 WARN (OverseerAutoScalingTriggerThread-98938564987781126-127.0.0.1:43368_solr-n_0000000000) [n:127.0.0.1:43368_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2686292 INFO (jetty-closer-3643-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4ed4ae8b{/solr,null,UNAVAILABLE}
[junit4] 2> 2686292 INFO (zkCallback-3650-thread-3-processing-n:127.0.0.1:33258_solr) [n:127.0.0.1:33258_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33258_solr
[junit4] 2> 2686310 INFO (jetty-closer-3643-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@28f88ae1{/solr,null,UNAVAILABLE}
[junit4] 2> 2686312 ERROR (SUITE-TestAuthenticationFramework-seed#[85D9181FA30EA2A4]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2686313 INFO (SUITE-TestAuthenticationFramework-seed#[85D9181FA30EA2A4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56108 56108
[junit4] 2> 2686880 INFO (Thread-5051) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56108 56108
[junit4] 2> 2686883 WARN (Thread-5051) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/configs/solrCloudCollectionConfig
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 24 /solr/collections/testcollection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_85D9181FA30EA2A4-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=BlockTreeOrds(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=619, maxMBSortInHeap=5.05951376803308, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@ff71f8b), locale=en-NZ, timezone=Europe/Monaco
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=3,threads=1,free=295869480,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [PathHierarchyTokenizerFactoryTest, TestAnalyzeInfixSuggestions, TestHdfsCloudBackupRestore, TestRecovery, BinaryUpdateRequestHandlerTest, TestStressRecovery, TestFieldTypeResource, DistributedDebugComponentTest, OutputWriterTest, TestCollationFieldDocValues, SmileWriterTest, TestCloudDeleteByQuery, TestCustomStream, HdfsCollectionsAPIDistributedZkTest, SignatureUpdateProcessorFactoryTest, WrapperMergePolicyFactoryTest, BasicDistributedZkTest, ResponseLogComponentTest, DistanceFunctionTest, TestXmlQParser, SolrCmdDistributorTest, BasicAuthStandaloneTest, OverseerModifyCollectionTest, BlockDirectoryTest, HttpSolrCallGetCoreTest, HLLSerializationTest, TestQuerySenderNoQuery, TestCollapseQParserPlugin, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestSolrCloudWithDelegationTokens, TestGraphTermsQParserPlugin, TestBinaryField, TestCloudManagedSchema, FastVectorHighlighterTest, TestSweetSpotSimilarityFactory, TestTolerantSearch, HighlighterConfigTest, TestHighlightDedupGrouping, DeleteShardTest, SuggesterFSTTest, DistributedFacetPivotSmallTest, TestTestInjection, CircularListTest, TestReRankQParserPlugin, HdfsAutoAddReplicasIntegrationTest, TestSQLHandlerNonCloud, DistributedQueryElevationComponentTest, TestOverriddenPrefixQueryForCustomFieldType, TestDFRSimilarityFactory, OverseerTest, SearchRateTriggerTest, TestRestManager, TestMinMaxOnMultiValuedField, TestIndexingPerformance, SortByFunctionTest, TestDistributedStatsComponentCardinality, SpellCheckCollatorTest, TestSolrXml, MultiTermTest, SolrCLIZkUtilsTest, NodeMutatorTest, TestPHPSerializedResponseWriter, NodeAddedTriggerTest, ResourceLoaderTest, TestDelegationWithHadoopAuth, TestConfigReload, QueryParsingTest, TestMiniSolrCloudClusterSSL, TestWriterPerf, TestExactSharedStatsCache, TestSubQueryTransformerCrossCore, DistributedFacetPivotLongTailTest, TestManagedSchema, SolrMetricsIntegrationTest, NotRequiredUniqueKeyTest, CleanupOldIndexTest, TestFieldResource, DateMathParserTest, RequestHandlersTest, TestLegacyNumericUtils, TestDocTermOrds, TestSchemaResource, ComputePlanActionTest, SpatialRPTFieldTypeTest, TestTolerantUpdateProcessorRandomCloud, PreAnalyzedFieldManagedSchemaCloudTest, TestMacros, DisMaxRequestHandlerTest, CloneFieldUpdateProcessorFactoryTest, TestManagedResource, CollectionsAPISolrJTest, SharedFSAutoReplicaFailoverTest, AutoscalingHistoryHandlerTest, SliceStateTest, TestLazyCores, IndexSchemaTest, TestRawResponseWriter, PreAnalyzedUpdateProcessorTest, EnumFieldTest, InfoHandlerTest, SyncSliceTest, BigEndianAscendingWordSerializerTest, TestSlowCompositeReaderWrapper, DistribCursorPagingTest, TestConfigSetsAPIZkFailure, ZkStateReaderTest, HdfsChaosMonkeyNothingIsSafeTest, SparseHLLTest, HdfsDirectoryTest, TestRealTimeGet, ClusterStateTest, TestSolr4Spatial, CursorPagingTest, TestUpdate, DistributedSuggestComponentTest, BlockJoinFacetSimpleTest, TestBackupRepositoryFactory, TestDistributedSearch, RecoveryZkTest, TestHttpShardHandlerFactory, TestPullReplicaErrorHandling, ReplicationFactorTest, TestConfigSets, HdfsDirectoryFactoryTest, V2ApiIntegrationTest, FieldAnalysisRequestHandlerTest, DistanceUnitsTest, ShufflingReplicaListTransformerTest, TestSchemaVersionResource, TestPerFieldSimilarityWithDefaultOverride, SolrXmlInZkTest, TestJmxIntegration, LeaderElectionTest, TestCursorMarkWithoutUniqueKey, TestSimpleQParserPlugin, SolrMetricManagerTest, DeleteNodeTest, TestRandomDVFaceting, TestCloudJSONFacetJoinDomain, TestUninvertingReader, TestReplicationHandler, SolrJmxReporterTest, CdcrBootstrapTest, TimeZoneUtilsTest, TestRetrieveFieldsOptimizer, AddSchemaFieldsUpdateProcessorFactoryTest, MinimalSchemaTest, OverriddenZkACLAndCredentialsProvidersTest, AsyncCallRequestStatusResponseTest, UnloadDistributedZkTest, LeaderFailoverAfterPartitionTest, TestPhraseSuggestions, TestInPlaceUpdatesDistrib, TestRestoreCore, TestLocalFSCloudBackupRestore, SaslZkACLProviderTest, TestManagedSchemaThreadSafety, TestMultiWordSynonyms, TestCloudPseudoReturnFields, TestFuzzyAnalyzedSuggestions, TestEmbeddedSolrServerAdminHandler, DistributedQueryComponentCustomSortTest, TestSolrCoreProperties, TestLeaderElectionZkExpiry, TestConfigsApi, ClassificationUpdateProcessorIntegrationTest, TemplateUpdateProcessorTest, ConfigureRecoveryStrategyTest, UpdateLogTest, AddReplicaTest, TestJoin, NumericFieldsTest, TestExceedMaxTermLength, XsltUpdateRequestHandlerTest, TestSimpleTextCodec, TestCloudNestedDocsSort, TestFieldCacheReopen, TestFieldCacheSortRandom, DistributedTermsComponentTest, DirectoryFactoryTest, TestManagedSynonymFilterFactory, TestXIncludeConfig, ZkCLITest, SolrCoreTest, SpellCheckComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, TestBadConfig, HighlighterTest, SolrIndexSplitterTest, SimplePostToolTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, TestTrie, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestAtomicUpdateErrorCases, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, SolrInfoBeanTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, TestQueryTypes, TestOmitPositions, XmlUpdateRequestHandlerTest, TestValueSourceCache, TermVectorComponentTest, RequiredFieldsTest, LoggingHandlerTest, TestCollationField, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, AlternateDirectoryTest, CopyFieldTest, TestMergePolicyConfig, TestSearchPerf, DirectSolrConnectionTest, TestLuceneMatchVersion, TestCodecSupport, OpenExchangeRatesOrgProviderTest, PluginInfoTest, ChaosMonkeyNothingIsSafeTest, BaseCdcrDistributedZkTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, ConnectionManagerTest, DeleteInactiveReplicaTest, DistribJoinFromCollectionTest, ForceLeaderTest, LeaderElectionContextKeyTest, LeaderInitiatedRecoveryOnCommitTest, MissingSegmentRecoveryTest, MoveReplicaTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerRolesTest, OverseerStatusTest, PeerSyncReplicationTest, SimpleCollectionCreateDeleteTest, TestAuthenticationFramework]
[junit4] Completed [536/747 (1!)] on J0 in 9.81s, 1 test, 1 error <<< FAILURES!
[...truncated 47895 lines...]
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build #
1513 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Error processing tokens: Error while parsing action 'Text/ZeroOrMore/FirstOf/Token/DelimitedToken/DelimitedToken_Action3' at input position (line 77, pos 4):
)"}
^
java.lang.OutOfMemoryError: Java heap space
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build #
1512 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1512/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 1) Thread[id=14722, name=jetty-launcher-3933-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 2) Thread[id=14719, name=jetty-launcher-3933-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
1) Thread[id=14722, name=jetty-launcher-3933-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
2) Thread[id=14719, name=jetty-launcher-3933-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
at __randomizedtesting.SeedInfo.seed([6F14AD5B8E558765]:0)
Build Log:
[...truncated 12279 lines...]
[junit4] Suite: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_6F14AD5B8E558765-001/init-core-data-001
[junit4] 2> 1269378 WARN (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
[junit4] 2> 1269378 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1269380 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1269380 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1269433 WARN (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 2> 1269516 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_6F14AD5B8E558765-001/tempDir-001
[junit4] 2> 1269517 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1269517 INFO (Thread-2144) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1269517 INFO (Thread-2144) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1269524 ERROR (Thread-2144) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1269621 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:40770
[junit4] 2> 1269829 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f87b332f30000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1269837 INFO (jetty-launcher-3933-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1269839 INFO (jetty-launcher-3933-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@dcf1138{/solr,null,AVAILABLE}
[junit4] 2> 1269839 INFO (jetty-launcher-3933-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2a923fde{SSL,[ssl, http/1.1]}{127.0.0.1:52104}
[junit4] 2> 1269839 INFO (jetty-launcher-3933-thread-1) [ ] o.e.j.s.Server Started @1271832ms
[junit4] 2> 1269839 INFO (jetty-launcher-3933-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52104}
[junit4] 2> 1269839 ERROR (jetty-launcher-3933-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1269840 INFO (jetty-launcher-3933-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1269840 INFO (jetty-launcher-3933-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1269840 INFO (jetty-launcher-3933-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1269840 INFO (jetty-launcher-3933-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-04T15:43:09.365Z
[junit4] 2> 1269845 INFO (jetty-launcher-3933-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1269851 INFO (jetty-launcher-3933-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@eb20fe5{/solr,null,AVAILABLE}
[junit4] 2> 1269854 INFO (jetty-launcher-3933-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6d7febf0{SSL,[ssl, http/1.1]}{127.0.0.1:63947}
[junit4] 2> 1269854 INFO (jetty-launcher-3933-thread-2) [ ] o.e.j.s.Server Started @1271847ms
[junit4] 2> 1269854 INFO (jetty-launcher-3933-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63947}
[junit4] 2> 1269854 ERROR (jetty-launcher-3933-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1269855 INFO (jetty-launcher-3933-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1269855 INFO (jetty-launcher-3933-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1269855 INFO (jetty-launcher-3933-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1269855 INFO (jetty-launcher-3933-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-04T15:43:09.380Z
[junit4] 2> 1269871 INFO (jetty-launcher-3933-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1269875 INFO (jetty-launcher-3933-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1269880 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f87b332f30002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1269889 INFO (jetty-launcher-3933-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40770/solr
[junit4] 2> 1269891 INFO (jetty-launcher-3933-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40770/solr
[junit4] 2> 1269994 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1269994 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:63947_solr
[junit4] 2> 1269996 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.c.Overseer Overseer (id=98946920549122053-127.0.0.1:63947_solr-n_0000000000) starting
[junit4] 2> 1270020 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63947_solr
[junit4] 2> 1270110 INFO (zkCallback-3944-thread-1-processing-n:127.0.0.1:63947_solr) [n:127.0.0.1:63947_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1270128 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 1270155 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1270158 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1270160 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52104_solr
[junit4] 2> 1270218 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=staff, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
[junit4] 2> 1270261 INFO (zkCallback-3945-thread-1-processing-n:127.0.0.1:52104_solr) [n:127.0.0.1:52104_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1270264 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 1270264 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=staff, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
[junit4] 2> 1270265 INFO (zkCallback-3944-thread-1-processing-n:127.0.0.1:63947_solr) [n:127.0.0.1:63947_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1270268 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 1270270 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 1270377 INFO (jetty-launcher-3933-thread-2-EventThread) [n:127.0.0.1:63947_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 1270379 INFO (jetty-launcher-3933-thread-1-EventThread) [n:127.0.0.1:52104_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 1270509 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
[junit4] 2> 1270513 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
[junit4] 2> 1270609 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52104.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9f42a4
[junit4] 2> 1270631 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63947.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9f42a4
[junit4] 2> 1270633 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52104.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9f42a4
[junit4] 2> 1270634 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52104.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9f42a4
[junit4] 2> 1270636 INFO (jetty-launcher-3933-thread-1) [n:127.0.0.1:52104_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_6F14AD5B8E558765-001/tempDir-001/node1/.
[junit4] 2> 1270642 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63947.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9f42a4
[junit4] 2> 1270642 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63947.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9f42a4
[junit4] 2> 1270643 INFO (jetty-launcher-3933-thread-2) [n:127.0.0.1:63947_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_6F14AD5B8E558765-001/tempDir-001/node2/.
[junit4] 2> 1270746 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1270749 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40770/solr ready
[junit4] 2> 1271329 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 1271430 INFO (qtp1967443251-14672) [n:127.0.0.1:52104_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1271430 INFO (qtp1967443251-14672) [n:127.0.0.1:52104_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1271431 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=simple-dt&e=1509846190939&s=2XM+gOy/KGdgrDWT9Lkb4eqC87k="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:10 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:10 GMT
[junit4] 2> 1271431 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 1271755 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 1286822 WARN (jetty-launcher-3933-thread-1-SendThread(127.0.0.1:40770)) [n:127.0.0.1:52104_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16185ms for sessionid 0x15f87b332f30006
[junit4] 2> 1286823 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f87b332f30006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1286823 WARN (jetty-launcher-3933-thread-2-SendThread(127.0.0.1:40770)) [n:127.0.0.1:63947_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16287ms for sessionid 0x15f87b332f30007
[junit4] 2> 1286823 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f87b332f30007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1286823 WARN (jetty-launcher-3933-thread-1-SendThread(127.0.0.1:40770)) [n:127.0.0.1:52104_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16285ms for sessionid 0x15f87b332f30008
[junit4] 2> 1286826 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f87b332f30008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1286829 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=simple-dt&e=1509846191292&s=BeS82OCBXUGWVCNCkIVYFP0Zcug="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:11 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:11 GMT
[junit4] 2> 1286830 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 1286839 WARN (jetty-launcher-3933-thread-2-SendThread(127.0.0.1:40770)) [n:127.0.0.1:63947_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15657ms for sessionid 0x15f87b332f30005
[junit4] 2> 1286899 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x15f87b332f30005 due to java.io.IOException: Connection reset by peer
[junit4] 2> 1286956 WARN (zkCallback-3952-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c26f888 name: ZooKeeperConnection Watcher:127.0.0.1:40770/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 1286956 WARN (zkCallback-3952-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 1287058 INFO (jetty-launcher-3933-thread-1-EventThread) [n:127.0.0.1:52104_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 1287065 WARN (zkCallback-3944-thread-1-processing-n:127.0.0.1:63947_solr) [n:127.0.0.1:63947_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f3cc540 name: ZooKeeperConnection Watcher:127.0.0.1:40770/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 1287065 WARN (zkCallback-3944-thread-1-processing-n:127.0.0.1:63947_solr) [n:127.0.0.1:63947_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 1287066 WARN (zkCallback-3945-thread-8-processing-n:127.0.0.1:52104_solr) [n:127.0.0.1:52104_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67412ed1 name: ZooKeeperConnection Watcher:127.0.0.1:40770/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 1287066 WARN (zkCallback-3945-thread-8-processing-n:127.0.0.1:52104_solr) [n:127.0.0.1:52104_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 1287164 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 1287292 INFO (qtp1967443251-14667) [n:127.0.0.1:52104_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1287292 INFO (qtp1967443251-14667) [n:127.0.0.1:52104_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1287293 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=simple-dt&e=1509846206696&s=iOVofiQYTTMBjVbbWw5U/E3Ng48="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:26 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:26 GMT
[junit4] 2> 1287293 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 1287989 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 1288031 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=simple-dt&e=1509846207519&s=S+F5VYhujYUHn+t9/R/Z2lN4vYg="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:27 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:27 GMT
[junit4] 2> 1288031 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 1288236 INFO (jetty-launcher-3933-thread-2-EventThread) [n:127.0.0.1:63947_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 1288625 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 1288647 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=simple-dt&e=1509846208170&s=OsQThnNHsNeb8q1a1vN/MPXfRBs="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:28 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:28 GMT
[junit4] 2> 1288648 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 1288929 WARN (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker-SendThread(127.0.0.1:40770)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15f87b332f3000a has expired
[junit4] 2> 1288930 WARN (zkCallback-3952-thread-4) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c26f888 name: ZooKeeperConnection Watcher:127.0.0.1:40770/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 1288930 WARN (zkCallback-3952-thread-4) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 1288930 WARN (zkCallback-3952-thread-4) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 1288935 INFO (zkCallback-3952-thread-4) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 1289105 INFO (zkCallback-3952-thread-4) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 1289105 INFO (zkCallback-3952-thread-4) [ ] o.a.s.c.c.ConnectionManager Connected:true
[junit4] 2> 1289365 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 1289430 WARN (qtp1967443251-14678) [ ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 1289433 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=simple-dt&e=1509846208909&s=wQAiGL0YgVGJz5BoHMWJThPcOq0="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:28 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:28 GMT
[junit4] 2> 1289434 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 1289921 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 1289939 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=simple-dt&e=1509846209460&s=MHDHzwQiHwCjuOHV63a9KWUZWVA="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:29 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:29 GMT
[junit4] 2> 1289940 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] IGNOR/A 0.00s J1 | TestImpersonationWithHadoopAuth.testForwarding
[junit4] > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/HADOOP-9893))
[junit4] 2> 1290469 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 1290515 INFO (qtp1967443251-14670) [n:127.0.0.1:52104_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1290515 INFO (qtp1967443251-14670) [n:127.0.0.1:52104_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1290516 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[6F14AD5B8E558765]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=simple-dt&e=1509846210040&s=p4ACG3GaFvHTvaFZJg/YyEG/C6c="; Domain=127.0.0.1; Expires=dom, 05-nov-2017 01:43:30 GMT; Secure; HttpOnly". Invalid 'expires' attribute: dom, 05-nov-2017 01:43:30 GMT
[junit4] 2> 1290516 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 1291313 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 1291331 INFO (qtp1967443251-14670) [n:127.0.0.1:52104_solr ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
[junit4] 2> at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1291331 WARN (qtp1967443251-14670) [n:127.0.0.1:52104_solr ] o.e.j.s.ServletHandler /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:457)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
[junit4] 2> at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> ... 29 more
[junit4] 2> 1291333 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[6F14AD5B8E558765]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 1291347 INFO (jetty-closer-3934-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6d7febf0{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1291348 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=806541637
[junit4] 2> 1291349 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1291349 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@32665245: rootName = solr_63947, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@73d6a0cb
[junit4] 2> 1291349 INFO (jetty-closer-3934-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@2a923fde{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1291353 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1191683032
[junit4] 2> 1291358 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1291358 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c2fb5a: rootName = solr_52104, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1fbeb7d4
[junit4] 2> 1291543 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1291543 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@64244324: rootName = solr_63947, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7595ece8
[junit4] 2> 1291749 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1291749 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2d57149f: rootName = solr_52104, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7595ece8
[junit4] 2> 1291755 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1291755 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6ceabdc3: rootName = solr_52104, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@51d1112d
[junit4] 2> 1291757 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:52104_solr
[junit4] 2> 1291758 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1291758 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@297b3868: rootName = solr_63947, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@51d1112d
[junit4] 2> 1291759 INFO (zkCallback-3944-thread-11-processing-n:127.0.0.1:63947_solr) [n:127.0.0.1:63947_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1291760 INFO (zkCallback-3945-thread-4-processing-n:127.0.0.1:52104_solr) [n:127.0.0.1:52104_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1291760 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1291763 INFO (jetty-closer-3934-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1291765 ERROR (Thread[Thread-2166,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:52104_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 1291766 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:63947_solr
[junit4] 2> 1291766 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1291766 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1291767 INFO (jetty-closer-3934-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98946920549122053-127.0.0.1:63947_solr-n_0000000000) closing
[junit4] 2> 1291767 WARN (OverseerAutoScalingTriggerThread-98946920549122053-127.0.0.1:63947_solr-n_0000000000) [n:127.0.0.1:63947_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1291809 INFO (jetty-closer-3934-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@dcf1138{/solr,null,UNAVAILABLE}
[junit4] 2> 1291814 INFO (OverseerStateUpdate-98946920549122053-127.0.0.1:63947_solr-n_0000000000) [n:127.0.0.1:63947_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:63947_solr
[junit4] 2> 1291816 INFO (zkCallback-3944-thread-3-processing-n:127.0.0.1:63947_solr) [n:127.0.0.1:63947_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1291821 ERROR (Thread[Thread-2164,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:63947_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 1291831 INFO (jetty-closer-3934-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@eb20fe5{/solr,null,UNAVAILABLE}
[junit4] 2> 1291838 ERROR (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1291838 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40770 40770
[junit4] 2> 1292146 INFO (Thread-2144) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40770 40770
[junit4] 2> 1292165 WARN (Thread-2144) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 1292180 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[6F14AD5B8E558765]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Nov 04, 2017 3:43:31 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> Nov 04, 2017 3:43:51 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
[junit4] 2> 1) Thread[id=14722, name=jetty-launcher-3933-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 2) Thread[id=14719, name=jetty-launcher-3933-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Nov 04, 2017 3:43:51 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=14722, name=jetty-launcher-3933-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] 2> 2) Thread[id=14719, name=jetty-launcher-3933-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] 2> 1312458 ERROR (jetty-launcher-3933-thread-1-EventThread) [n:127.0.0.1:52104_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 1312458 ERROR (jetty-launcher-3933-thread-2-EventThread) [n:127.0.0.1:63947_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Nov 04, 2017 3:43:51 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@d64901), locale=es-BO, timezone=America/Bahia_Banderas
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=3,threads=1,free=345813744,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [BasicAuthIntegrationTest, LukeRequestHandlerTest, TestNumericTerms64, TestConfigSetsAPI, DocumentBuilderTest, TestQueryUtils, TestSearcherReuse, TestBinaryResponseWriter, TestDistributedMissingSort, StatsReloadRaceTest, TestCharFilters, HdfsWriteToMultipleCollectionsTest, RemoteQueryErrorTest, SolrSlf4jReporterTest, PolyFieldTest, CoreAdminHandlerTest, DocExpirationUpdateProcessorFactoryTest, CustomCollectionTest, TestNumericRangeQuery32, NodeMutatorTest, TestBlobHandler, SOLR749Test, TestJsonFacets, DistributedExpandComponentTest, ZkSolrClientTest, TestScoreJoinQPScore, TestSolrIndexConfig, MigrateRouteKeyTest, TestCollationField, AliasIntegrationTest, TestCloudSearcherWarming, TestSQLHandler, TestSegmentSorting, TestSolrCloudWithDelegationTokens, TestFastOutputStream, TestSuggestSpellingConverter, TestCSVLoader, TestLocalFSCloudBackupRestore, TestConfig, JsonLoaderTest, RuleEngineTest, TestRandomRequestDistribution, TestSha256AuthenticationProvider, FacetPivotSmallTest, BufferStoreTest, OverseerModifyCollectionTest, OpenCloseCoreStressTest, NumberUtilsTest, TestIntervalFaceting, TestNestedDocsSort, TestBadConfig, TestDeleteCollectionOnDownNodes, TestRemoteStreaming, TestHashPartitioner, TestSystemIdResolver, DebugComponentTest, SolrCLIZkUtilsTest, AssignTest, FieldMutatingUpdateProcessorTest, TestTrie, ResponseHeaderTest, MetricsHandlerTest, DeleteStatusTest, TestBM25SimilarityFactory, TestTolerantUpdateProcessorRandomCloud, BaseCdcrDistributedZkTest, TestLegacyFieldReuse, TestRandomFaceting, TestQueryWrapperFilter, CacheHeaderTest, TestReload, TestRTGBase, CloudExitableDirectoryReaderTest, TestSolrConfigHandlerCloud, TestConfigSetProperties, TestClassicSimilarityFactory, TestRawTransformer, TestInfoStreamLogging, FileBasedSpellCheckerTest, CopyFieldTest, TestDynamicFieldCollectionResource, HLLUtilTest, ConnectionManagerTest, TestExactStatsCache, TestCrossCoreJoin, SolrJmxReporterCloudTest, TestManagedResourceStorage, TestExtendedDismaxParser, ReplicaListTransformerTest, TestComplexPhraseLeadingWildcard, SolrXmlInZkTest, UUIDUpdateProcessorFallbackTest, TestCloudSchemaless, TestLuceneMatchVersion, PeerSyncTest, BigEndianAscendingWordDeserializerTest, ConcurrentDeleteAndCreateCollectionTest, CdcrVersionReplicationTest, TestCloudPseudoReturnFields, TestConfigSetsAPIZkFailure, TestMergePolicyConfig, TestRequestStatusCollectionAPI, TestLegacyFieldCache, TestGraphMLResponseWriter, TermsComponentTest, TestClusterStateMutator, TestDocSet, TestMiniSolrCloudClusterSSL, DistributedFacetPivotSmallAdvancedTest, TestHalfAndHalfDocValues, TestLegacyNumericRangeQueryBuilder, TermVectorComponentTest, FullHLLTest, TestDistribIDF, TestSolrQueryParser, MoveReplicaTest, ClassificationUpdateProcessorFactoryTest, BasicZkTest, TestSerializedLuceneMatchVersion, ComputePlanActionTest, UpdateParamsTest, TestDistributedGrouping, TestCorePropertiesReload, CdcrReplicationHandlerTest, TestImpersonationWithHadoopAuth]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=6F14AD5B8E558765 -Dtests.slow=true -Dtests.locale=es-BO -Dtests.timezone=America/Bahia_Banderas -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestImpersonationWithHadoopAuth (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
[junit4] > 1) Thread[id=14722, name=jetty-launcher-3933-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > 2) Thread[id=14719, name=jetty-launcher-3933-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([6F14AD5B8E558765]:0)
[junit4] Completed [255/749 (1!)] on J1 in 43.14s, 10 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 48952 lines...]
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build #
1511 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1511/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=15273, name=jetty-launcher-3490-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 2) Thread[id=15284, name=jetty-launcher-3490-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=15273, name=jetty-launcher-3490-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
2) Thread[id=15284, name=jetty-launcher-3490-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
at __randomizedtesting.SeedInfo.seed([8ED03A97C5419ABA]:0)
Build Log:
[...truncated 12398 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_8ED03A97C5419ABA-001/init-core-data-001
[junit4] 2> 1456078 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 1456078 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1456079 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1456079 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1456119 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_8ED03A97C5419ABA-001/tempDir-001
[junit4] 2> 1456120 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1456120 INFO (Thread-2772) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1456120 INFO (Thread-2772) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1456123 ERROR (Thread-2772) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1456220 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:58676
[junit4] 2> 1456239 INFO (jetty-launcher-3490-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1456239 INFO (jetty-launcher-3490-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1456241 INFO (jetty-launcher-3490-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4110ca20{/solr,null,AVAILABLE}
[junit4] 2> 1456241 INFO (jetty-launcher-3490-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27590ac1{/solr,null,AVAILABLE}
[junit4] 2> 1456242 INFO (jetty-launcher-3490-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@744b703d{SSL,[ssl, http/1.1]}{127.0.0.1:47857}
[junit4] 2> 1456242 INFO (jetty-launcher-3490-thread-2) [ ] o.e.j.s.Server Started @1458638ms
[junit4] 2> 1456242 INFO (jetty-launcher-3490-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47857}
[junit4] 2> 1456242 ERROR (jetty-launcher-3490-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1456242 INFO (jetty-launcher-3490-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1456242 INFO (jetty-launcher-3490-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1456242 INFO (jetty-launcher-3490-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1456242 INFO (jetty-launcher-3490-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-04T05:39:38.935Z
[junit4] 2> 1456245 INFO (jetty-launcher-3490-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5586b60e{SSL,[ssl, http/1.1]}{127.0.0.1:37670}
[junit4] 2> 1456245 INFO (jetty-launcher-3490-thread-1) [ ] o.e.j.s.Server Started @1458641ms
[junit4] 2> 1456245 INFO (jetty-launcher-3490-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37670}
[junit4] 2> 1456245 ERROR (jetty-launcher-3490-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1456245 INFO (jetty-launcher-3490-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1456245 INFO (jetty-launcher-3490-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1456245 INFO (jetty-launcher-3490-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1456245 INFO (jetty-launcher-3490-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-04T05:39:38.938Z
[junit4] 2> 1456249 INFO (jetty-launcher-3490-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1456249 INFO (jetty-launcher-3490-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1456256 INFO (jetty-launcher-3490-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58676/solr
[junit4] 2> 1456256 INFO (jetty-launcher-3490-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58676/solr
[junit4] 2> 1456405 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1456408 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1456408 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47857_solr
[junit4] 2> 1456410 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37670_solr
[junit4] 2> 1456411 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.Overseer Overseer (id=98944547475554310-127.0.0.1:47857_solr-n_0000000000) starting
[junit4] 2> 1456438 INFO (OverseerStateUpdate-98944547475554310-127.0.0.1:47857_solr-n_0000000000) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1456439 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47857_solr
[junit4] 2> 1456451 INFO (zkCallback-3501-thread-2-processing-n:127.0.0.1:37670_solr) [n:127.0.0.1:37670_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1456465 INFO (zkCallback-3502-thread-1-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1456470 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 1456470 WARN (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1456470 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 1456472 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 1456474 INFO (jetty-launcher-3490-thread-2-EventThread) [n:127.0.0.1:47857_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 1456505 WARN (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1456531 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 1456531 WARN (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1456535 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 1456537 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 1456541 INFO (jetty-launcher-3490-thread-1-EventThread) [n:127.0.0.1:37670_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 1456554 WARN (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 1456557 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47857.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31f2106b
[junit4] 2> 1456565 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47857.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31f2106b
[junit4] 2> 1456565 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47857.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31f2106b
[junit4] 2> 1456566 INFO (jetty-launcher-3490-thread-2) [n:127.0.0.1:47857_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_8ED03A97C5419ABA-001/tempDir-001/node2/.
[junit4] 2> 1456586 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37670.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31f2106b
[junit4] 2> 1456598 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37670.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31f2106b
[junit4] 2> 1456598 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37670.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31f2106b
[junit4] 2> 1456599 INFO (jetty-launcher-3490-thread-1) [n:127.0.0.1:37670_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_8ED03A97C5419ABA-001/tempDir-001/node1/.
[junit4] 2> 1456744 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 1456773 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1509809979463&s=/GRZrxaUxfAXfHl78Eh8zT4J6zE="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:39 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:39 GMT
[junit4] 2> 1456774 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 1456903 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 1456908 INFO (qtp2123730759-15226) [n:127.0.0.1:47857_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1456908 INFO (qtp2123730759-15226) [n:127.0.0.1:47857_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1456909 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1509809979599&s=JgvmdKpO0SKbsfuRhHGRdMmS1OQ="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:39 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:39 GMT
[junit4] 2> 1456909 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 1457026 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 1457033 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1509809979720&s=+bTxSJko2EmJCpFnKKPiCqI0IGA="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:39 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:39 GMT
[junit4] 2> 1457033 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 1457160 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 1472174 WARN (jetty-launcher-3490-thread-1-SendThread(127.0.0.1:58676)) [n:127.0.0.1:37670_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15573ms for sessionid 0x15f858aacbe0008
[junit4] 2> 1472174 WARN (jetty-launcher-3490-thread-1-SendThread(127.0.0.1:58676)) [n:127.0.0.1:37670_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15574ms for sessionid 0x15f858aacbe0005
[junit4] 2> 1472174 WARN (jetty-launcher-3490-thread-2-SendThread(127.0.0.1:58676)) [n:127.0.0.1:47857_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15573ms for sessionid 0x15f858aacbe0007
[junit4] 2> 1472174 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f858aacbe0005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1472174 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f858aacbe0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1472174 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f858aacbe0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1472174 WARN (jetty-launcher-3490-thread-2-SendThread(127.0.0.1:58676)) [n:127.0.0.1:47857_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15607ms for sessionid 0x15f858aacbe0006
[junit4] 2> 1472175 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f858aacbe0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1472175 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1509809979853&s=FDu5Y1KBYllr2AzvHVlvd/seZIg="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:39 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:39 GMT
[junit4] 2> 1472175 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 1472281 INFO (jetty-launcher-3490-thread-2-EventThread) [n:127.0.0.1:47857_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 1472285 INFO (jetty-launcher-3490-thread-1-EventThread) [n:127.0.0.1:37670_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 1472290 WARN (zkCallback-3501-thread-6-processing-n:127.0.0.1:37670_solr) [n:127.0.0.1:37670_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@13390357 name: ZooKeeperConnection Watcher:127.0.0.1:58676/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 1472290 WARN (zkCallback-3501-thread-6-processing-n:127.0.0.1:37670_solr) [n:127.0.0.1:37670_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 1472303 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 1472304 WARN (zkCallback-3502-thread-4-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4d83d60b name: ZooKeeperConnection Watcher:127.0.0.1:58676/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 1472305 WARN (zkCallback-3502-thread-4-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 1472811 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1472812 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58676/solr ready
[junit4] 2> 1472817 INFO (qtp2123730759-15229) [n:127.0.0.1:47857_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1473832 INFO (OverseerThreadFactory-5184-thread-1-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 1473947 INFO (OverseerStateUpdate-98944547475554310-127.0.0.1:47857_solr-n_0000000000) [n:127.0.0.1:47857_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:47857/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1474153 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1474153 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1474257 INFO (zkCallback-3502-thread-7-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1474257 INFO (zkCallback-3502-thread-3-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1475173 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1475198 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 1475268 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1475285 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 1475285 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47857.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31f2106b
[junit4] 2> 1475285 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1475285 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_8ED03A97C5419ABA-001/tempDir-001/node2/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_8ED03A97C5419ABA-001/tempDir-001/node2/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 1475287 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=22.0654296875, floorSegmentMB=2.072265625, forceMergeDeletesPctAllowed=16.053855916750578, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1475334 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1475334 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1475334 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1475334 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1475335 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1475335 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@443f0345[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 1475337 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 1475340 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 1475351 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1475351 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583112779772985344
[junit4] 2> 1475351 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 1475352 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 1475352 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 1475352 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 1475352 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 1475353 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 1475353 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 1475353 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 1475353 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 1475354 INFO (searcherExecutor-5189-thread-1-processing-n:127.0.0.1:47857_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@443f0345[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1475357 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1475357 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1475357 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:47857/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 1475357 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1475357 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:47857/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 1475357 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1475363 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:47857/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 1475464 INFO (zkCallback-3502-thread-3-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1475464 INFO (zkCallback-3502-thread-7-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1475514 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1475516 INFO (qtp2123730759-15231) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1363
[junit4] 2> 1475516 WARN (httpShardExecutor-5180-thread-1-processing-n:127.0.0.1:47857_solr [https:////127.0.0.1:47857//solr] https:////127.0.0.1:47857//solr) [n:127.0.0.1:47857_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1509809996845&s=dPHWRMkQGCITjdnn+eCFnU/I9ic="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:56 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:56 GMT
[junit4] 2> 1475522 INFO (qtp2123730759-15229) [n:127.0.0.1:47857_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1475617 INFO (zkCallback-3502-thread-7-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1475617 INFO (zkCallback-3502-thread-3-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1475840 INFO (OverseerCollectionConfigSetProcessor-98944547475554310-127.0.0.1:47857_solr-n_0000000000) [n:127.0.0.1:47857_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1476529 INFO (qtp2123730759-15229) [n:127.0.0.1:47857_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3712
[junit4] 2> 1476529 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1509809995509&s=V/1uLzGu6gqKNALBcIAOs1snAv8="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:55 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:55 GMT
[junit4] 2> 1476531 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 1476532 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 1476536 INFO (qtp2123730759-15226) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1476536 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1509809999229&s=19ocP/LglkPpqt8gOvYo9/IENjo="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:59 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:59 GMT
[junit4] 2> 1476559 INFO (qtp136203966-15237) [n:127.0.0.1:37670_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1476562 INFO (qtp2123730759-15228) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1476562 WARN (qtp136203966-15237) [n:127.0.0.1:37670_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1509809999254&s=UsKJR24nlh185OCP6rjIUR77Elw="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:59 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:59 GMT
[junit4] 2> 1476562 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1509809999251&s=9DwFMGMVUWOOAk7DeWjt0zFnnFM="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:59 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:59 GMT
[junit4] 2> 1476562 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1509809999254&s=UsKJR24nlh185OCP6rjIUR77Elw="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:59 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:59 GMT
[junit4] 2> 1476563 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 1476724 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 1476728 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1509809999419&s=aUfXfB8BtJXdqOhA61UmSqtAqEM="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:59 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:59 GMT
[junit4] 2> 1476728 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 1476884 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 1476891 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1509809999577&s=k+0R8CyiiW9RneLWt0xAJ05LflE="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:59 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:59 GMT
[junit4] 2> 1476891 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 1477046 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 1477085 INFO (qtp2123730759-15232) [n:127.0.0.1:47857_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1477085 INFO (qtp2123730759-15232) [n:127.0.0.1:47857_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1477085 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1509809999739&s=Q3PwFEQUD5vrNiHpNr2882xDXnE="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:39:59 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:39:59 GMT
[junit4] 2> 1477085 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 1477287 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 1477288 INFO (qtp2123730759-15229) [n:127.0.0.1:47857_solr ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1477288 WARN (qtp2123730759-15229) [n:127.0.0.1:47857_solr ] o.e.j.s.ServletHandler /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:457)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> ... 29 more
[junit4] 2> 1477289 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 1477448 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 1477471 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1509810000143&s=cniY3gHeaX4wHVCQHcps9r6iDKY="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:40:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:40:00 GMT
[junit4] 2> 1477471 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 1477624 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 1477624 INFO (qtp2123730759-15232) [n:127.0.0.1:47857_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1477625 INFO (qtp2123730759-15232) [n:127.0.0.1:47857_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1477625 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1509810000317&s=usS8wffXHxquRxc8ZEq4pYBkTYY="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:40:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:40:00 GMT
[junit4] 2> 1477625 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 1477777 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 1477798 WARN (qtp2123730759-15229) [n:127.0.0.1:47857_solr ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 1477803 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[8ED03A97C5419ABA]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1509810000470&s=ipj/VrOUm+7f6dpetKCz2DhAKnk="; Path=/; Domain=127.0.0.1; Expires=So, 04-nov-2017 15:40:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: So, 04-nov-2017 15:40:00 GMT
[junit4] 2> 1477803 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[8ED03A97C5419ABA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 1477806 INFO (jetty-closer-3491-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5586b60e{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1477808 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1527103198
[junit4] 2> 1477809 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1477809 INFO (jetty-closer-3491-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@744b703d{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1477809 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6541fb76: rootName = solr_37670, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@17c69c21
[junit4] 2> 1477810 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=832136424
[junit4] 2> 1477811 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1477811 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@49e027ee: rootName = solr_47857, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4f825777
[junit4] 2> 1477817 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1477817 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1477817 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@25a17656: rootName = solr_47857, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@24f7df09
[junit4] 2> 1477817 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@481dcf25: rootName = solr_37670, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@24f7df09
[junit4] 2> 1477822 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1477822 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1581215d: rootName = solr_47857, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@17ad53c8
[junit4] 2> 1477823 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1477823 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c2f97ea: rootName = solr_37670, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@17ad53c8
[junit4] 2> 1477823 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:47857_solr
[junit4] 2> 1477824 INFO (zkCallback-3502-thread-3-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1477824 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1477825 INFO (zkCallback-3501-thread-1-processing-n:127.0.0.1:37670_solr) [n:127.0.0.1:37670_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1477827 INFO (zkCallback-3502-thread-1-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1477827 INFO (zkCallback-3502-thread-7-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1477827 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37670_solr
[junit4] 2> 1477828 INFO (coreCloseExecutor-5194-thread-1) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@357be985
[junit4] 2> 1477828 INFO (coreCloseExecutor-5194-thread-1) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=897313157
[junit4] 2> 1477828 INFO (coreCloseExecutor-5194-thread-1) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5f6be59: rootName = solr_47857, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@3ec3c40f
[junit4] 2> 1477829 INFO (jetty-closer-3491-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1477829 INFO (zkCallback-3501-thread-1-processing-n:127.0.0.1:37670_solr) [n:127.0.0.1:37670_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1477831 INFO (zkCallback-3502-thread-7-processing-n:127.0.0.1:47857_solr) [n:127.0.0.1:47857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1477833 ERROR (Thread[Thread-2791,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:37670_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 1477839 INFO (jetty-closer-3491-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@27590ac1{/solr,null,UNAVAILABLE}
[junit4] 2> 1477848 INFO (coreCloseExecutor-5194-thread-1) [n:127.0.0.1:47857_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=897313157
[junit4] 2> 1477853 INFO (jetty-closer-3491-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98944547475554310-127.0.0.1:47857_solr-n_0000000000) closing
[junit4] 2> 1477853 WARN (OverseerAutoScalingTriggerThread-98944547475554310-127.0.0.1:47857_solr-n_0000000000) [n:127.0.0.1:47857_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1477853 INFO (OverseerStateUpdate-98944547475554310-127.0.0.1:47857_solr-n_0000000000) [n:127.0.0.1:47857_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:47857_solr
[junit4] 2> 1477861 ERROR (Thread[Thread-2789,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:47857_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 1477870 INFO (jetty-closer-3491-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4110ca20{/solr,null,UNAVAILABLE}
[junit4] 2> 1477871 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1477872 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58676 58676
[junit4] 2> 1477920 INFO (Thread-2772) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58676 58676
[junit4] 2> 1477927 WARN (Thread-2772) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/forwardingCollection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 1477956 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[8ED03A97C5419ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Nov 04, 2017 5:40:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> Nov 04, 2017 5:40:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] 2> 1) Thread[id=15273, name=jetty-launcher-3490-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 2) Thread[id=15284, name=jetty-launcher-3490-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Nov 04, 2017 5:40:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=15273, name=jetty-launcher-3490-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 2) Thread[id=15284, name=jetty-launcher-3490-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 1498102 ERROR (jetty-launcher-3490-thread-1-EventThread) [n:127.0.0.1:37670_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 1498102 ERROR (jetty-launcher-3490-thread-2-EventThread) [n:127.0.0.1:47857_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Nov 04, 2017 5:40:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=790, maxMBSortInHeap=6.857185809706017, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3e122d9a), locale=sk-SK, timezone=Pacific/Yap
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=3,threads=1,free=163351976,total=515899392
[junit4] 2> NOTE: All tests run in this JVM: [AtomicUpdateProcessorFactoryTest, BasicFunctionalityTest, TestFilteredDocIdSet, SpellPossibilityIteratorTest, MetricsHandlerTest, DistributedExpandComponentTest, SaslZkACLProviderTest, ReplicaListTransformerTest, TestLuceneMatchVersion, TestQueryUtils, TestJsonFacets, TestDynamicLoading, QueryElevationComponentTest, TestSuggestSpellingConverter, TestBlendedInfixSuggestions, TestNumericRangeQuery32, SearchHandlerTest, ManagedSchemaRoundRobinCloudTest, TestBlobHandler, TestExtendedDismaxParser, TestStressVersions, ChaosMonkeySafeLeaderTest, SystemInfoHandlerTest, DistributedFacetPivotSmallAdvancedTest, TestMiniSolrCloudClusterSSL, SolrXmlInZkTest, TestComponentsName, DistributedQueueTest, CloudMLTQParserTest, SpellingQueryConverterTest, ParsingFieldUpdateProcessorsTest, TestSQLHandler, TestLegacyFieldReuse, TestSolrConfigHandler, TestDynamicFieldCollectionResource, ActionThrottleTest, TestHalfAndHalfDocValues, CopyFieldTest, StatelessScriptUpdateProcessorFactoryTest, LeaderInitiatedRecoveryOnShardRestartTest, TestReplicaProperties, MoreLikeThisHandlerTest, CacheHeaderTest, TermVectorComponentDistributedTest, GraphQueryTest, TestPostingsSolrHighlighter, TestLocalFSCloudBackupRestore, ConnectionManagerTest, TestZkAclsWithHadoopAuth, CollectionsAPIDistributedZkTest, FacetPivotSmallTest, DeleteReplicaTest, BigEndianAscendingWordDeserializerTest, TestSegmentSorting, TestAnalyzedSuggestions, UpdateParamsTest, CachingDirectoryFactoryTest, SolrIndexSplitterTest, CdcrReplicationHandlerTest, TestGroupingSearch, TestSearchPerf, LukeRequestHandlerTest, BufferStoreTest, ResponseHeaderTest, OverseerStatusTest, CoreMergeIndexesAdminHandlerTest, TestHdfsUpdateLog, TestSchemaSimilarityResource, TestDocSet, SoftAutoCommitTest, CdcrBootstrapTest, TestHdfsBackupRestoreCore, TestOrdValues, TestZkChroot, MigrateRouteKeyTest, TestSystemIdResolver, CoreAdminHandlerTest, AssignTest, TestPKIAuthenticationPlugin, ClassificationUpdateProcessorTest, PreAnalyzedFieldTest, TestCoreAdminApis, TestSubQueryTransformerDistrib, TestDeleteCollectionOnDownNodes, AnalysisAfterCoreReloadTest, HdfsWriteToMultipleCollectionsTest, TestNumericTerms64, ExitableDirectoryReaderTest, NodeMutatorTest, TestMergePolicyConfig, TestPolicyCloud, TestFieldCache, UtilsToolTest, ZkFailoverTest, SecurityConfHandlerTest, TestSystemCollAutoCreate, TestStandardQParsers, TestTlogReplica, TestNonDefinedSimilarityFactory, LargeFieldTest, TestSolrCloudWithDelegationTokens, ClassificationUpdateProcessorFactoryTest, TestManagedSchemaAPI, TestRandomFaceting, SolrCLIZkUtilsTest, TestIndexSearcher, TestMacroExpander, SchemaVersionSpecificBehaviorTest, TestGraphMLResponseWriter, TestInfoStreamLogging, DOMUtilTest, PluginInfoTest, DocValuesTest, ZkSolrClientTest, TestPivotHelperCode, TestPayloadCheckQParserPlugin, TestSolrQueryResponse, TestExportWriter, TestUnifiedSolrHighlighter, TestCustomSort, PKIAuthenticationIntegrationTest, TestFreeTextSuggestions, TestDistribIDF, BlobRepositoryCloudTest, FieldMutatingUpdateProcessorTest, TestShardHandlerFactory, BitVectorTest, PolyFieldTest, TestLegacyNumericRangeQueryBuilder, TestFunctionQuery, TestLMJelinekMercerSimilarityFactory, TestCrossCoreJoin, DeleteLastCustomShardedReplicaTest, NodeAddedTriggerTest, HdfsBasicDistributedZkTest, LeaderElectionContextKeyTest, TestSolrCLIRunExample, TestReload, TestRTGBase, TestRandomRequestDistribution, BaseCdcrDistributedZkTest, ZkNodePropsTest, DocExpirationUpdateProcessorFactoryTest, DocValuesMissingTest, SolrIndexConfigTest, PingRequestHandlerTest, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=8ED03A97C5419ABA -Dtests.slow=true -Dtests.locale=sk-SK -Dtests.timezone=Pacific/Yap -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=15273, name=jetty-launcher-3490-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > 2) Thread[id=15284, name=jetty-launcher-3490-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([8ED03A97C5419ABA]:0)
[junit4] Completed [284/749 (1!)] on J1 in 42.04s, 12 tests, 1 error <<< FAILURES!
[...truncated 48848 lines...]
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build #
1510 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1510/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
3 tests failed.
FAILED: org.apache.lucene.search.similarities.TestBasicModelG.testRandomScoring
Error Message:
score(1.0,3)=1.4E-44 < score(1.0,4)=1.5E-44
Stack Trace:
java.lang.AssertionError: score(1.0,3)=1.4E-44 < score(1.0,4)=1.5E-44
at __randomizedtesting.SeedInfo.seed([C4EB518D67B3204:87D1ECAACC0CD40E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.search.similarities.BaseSimilarityTestCase.doTestScoring(BaseSimilarityTestCase.java:423)
at org.apache.lucene.search.similarities.BaseSimilarityTestCase.testRandomScoring(BaseSimilarityTestCase.java:355)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=35816, name=jetty-launcher-5622-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=35816, name=jetty-launcher-5622-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
at __randomizedtesting.SeedInfo.seed([74DBAE9381324320]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 1) Thread[id=7317, name=jetty-launcher-1259-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
1) Thread[id=7317, name=jetty-launcher-1259-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
at __randomizedtesting.SeedInfo.seed([74DBAE9381324320]:0)
Build Log:
[...truncated 539 lines...]
[junit4] Suite: org.apache.lucene.search.similarities.TestBasicModelG
[junit4] 1> 1.4E-44 = score(DFRSimilarity, doc=0, freq=1.0), computed from:
[junit4] 1> 1.4E-45 = boost
[junit4] 1> 2.60766362E16 = NormalizationH1, computed from:
[junit4] 1> 1.0 = tf
[junit4] 1> 9.2193805E8 = avgFieldLength
[junit4] 1> 3.0 = len
[junit4] 1> 1.82536454E17 = BasicModelG, computed from:
[junit4] 1> 252.0 = numberOfDocuments
[junit4] 1> 1.0 = totalTermFreq
[junit4] 1> 5.7522755E-17 = AfterEffectB, computed from:
[junit4] 1> 2.60766362E16 = tfn
[junit4] 1> 1.0 = totalTermFreq
[junit4] 1> 1.0 = docFreq
[junit4] 1>
[junit4] 1> 1.5E-44 = score(DFRSimilarity, doc=0, freq=1.0), computed from:
[junit4] 1> 1.4E-45 = boost
[junit4] 1> 1.95574772E16 = NormalizationH1, computed from:
[junit4] 1> 1.0 = tf
[junit4] 1> 9.2193805E8 = avgFieldLength
[junit4] 1> 4.0 = len
[junit4] 1> 1.3690234E17 = BasicModelG, computed from:
[junit4] 1> 252.0 = numberOfDocuments
[junit4] 1> 1.0 = totalTermFreq
[junit4] 1> 7.669701E-17 = AfterEffectB, computed from:
[junit4] 1> 1.95574772E16 = tfn
[junit4] 1> 1.0 = totalTermFreq
[junit4] 1> 1.0 = docFreq
[junit4] 1>
[junit4] 1> DFR GB1
[junit4] 1> field="field",maxDoc=364,docCount=252,sumTotalTermFreq=232328387687,sumDocFreq=232328387687
[junit4] 1> term="term",docFreq=1,totalTermFreq=1
[junit4] 1> norm=4 (doc length ~ 4)
[junit4] 1> freq=1.0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestBasicModelG -Dtests.method=testRandomScoring -Dtests.seed=C4EB518D67B3204 -Dtests.slow=true -Dtests.locale=ar-SA -Dtests.timezone=Etc/GMT+9 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 2.88s J1 | TestBasicModelG.testRandomScoring <<<
[junit4] > Throwable #1: java.lang.AssertionError: score(1.0,3)=1.4E-44 < score(1.0,4)=1.5E-44
[junit4] > at __randomizedtesting.SeedInfo.seed([C4EB518D67B3204:87D1ECAACC0CD40E]:0)
[junit4] > at org.apache.lucene.search.similarities.BaseSimilarityTestCase.doTestScoring(BaseSimilarityTestCase.java:423)
[junit4] > at org.apache.lucene.search.similarities.BaseSimilarityTestCase.testRandomScoring(BaseSimilarityTestCase.java:355)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {field=PostingsFormat(name=Memory)}, docValues:{}, maxPointsInLeafNode=1142, maxMBSortInHeap=7.073634372172995, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@16c326ce), locale=ar-SA, timezone=Etc/GMT+9
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=3,threads=1,free=145887688,total=271568896
[junit4] 2> NOTE: All tests run in this JVM: [TestWeakIdentityMap, TestMultiFields, TestSpanMultiTermQueryWrapper, TestLucene50StoredFieldsFormatHighCompression, TestConstantScoreQuery, TestGraphTokenizers, TestDuelingCodecsAtNight, TestBasicModelBE, TestSentinelIntSet, TestIndexedDISI, TestPerSegmentDeletes, TestFixedBitSet, TestSpanOrQuery, TestSimpleExplanations, TestPositiveScoresOnlyCollector, TestParallelTermEnum, TestTransactionRollback, TestStressIndexing2, TestComplexExplanationsOfNonMatches, TestAxiomaticSimilarity, TestEarlyTermination, TestSimpleSearchEquivalence, TestShardSearching, TestTopFieldCollector, TestPerFieldPostingsFormat2, FiniteStringsIteratorTest, TestTryDelete, TestTrackingDirectoryWrapper, TestDocumentWriter, TestPagedBytes, TestAxiomaticF1EXP, TestMergeSchedulerExternal, TestStressAdvance, TestCompiledAutomaton, TestStressNRT, TestBoostQuery, TestAllFilesHaveChecksumFooter, TestIndexWriterNRTIsCurrent, TestIndexCommit, TestDoubleValuesSource, TestDisjunctionMaxQuery, TestSimilarity, TestPackedInts, TestMatchNoDocsQuery, TestExitableDirectoryReader, TestFixedBitDocIdSet, TestBasicModelG]
[junit4] Completed [97/475 (1!)] on J1 in 2.91s, 1 test, 1 failure <<< FAILURES!
[...truncated 11179 lines...]
[junit4] Suite: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
[junit4] 2> 429671 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_74DBAE9381324320-001/init-core-data-001
[junit4] 2> 429671 WARN (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
[junit4] 2> 429671 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 429673 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 429704 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_74DBAE9381324320-001/tempDir-001
[junit4] 2> 429704 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 429704 INFO (Thread-2287) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 429704 INFO (Thread-2287) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 429706 ERROR (Thread-2287) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 429804 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:50234
[junit4] 2> 429819 INFO (jetty-launcher-1259-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 429821 INFO (jetty-launcher-1259-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 429824 INFO (jetty-launcher-1259-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4003fba4{/solr,null,AVAILABLE}
[junit4] 2> 429824 INFO (jetty-launcher-1259-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18cae014{/solr,null,AVAILABLE}
[junit4] 2> 429826 INFO (jetty-launcher-1259-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6697c04e{HTTP/1.1,[http/1.1]}{127.0.0.1:42338}
[junit4] 2> 429827 INFO (jetty-launcher-1259-thread-2) [ ] o.e.j.s.Server Started @431656ms
[junit4] 2> 429827 INFO (jetty-launcher-1259-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42338}
[junit4] 2> 429827 INFO (jetty-launcher-1259-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@53f1ee4{HTTP/1.1,[http/1.1]}{127.0.0.1:58089}
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-1) [ ] o.e.j.s.Server Started @431657ms
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58089}
[junit4] 2> 429828 ERROR (jetty-launcher-1259-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 429828 ERROR (jetty-launcher-1259-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T20:24:11.389Z
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 429828 INFO (jetty-launcher-1259-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T20:24:11.389Z
[junit4] 2> 429832 INFO (jetty-launcher-1259-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 429835 INFO (jetty-launcher-1259-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 429842 INFO (jetty-launcher-1259-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50234/solr
[junit4] 2> 429844 INFO (jetty-launcher-1259-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50234/solr
[junit4] 2> 429994 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 429994 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 429996 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58089_solr
[junit4] 2> 429996 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42338_solr
[junit4] 2> 429997 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.c.Overseer Overseer (id=98942363321368582-127.0.0.1:58089_solr-n_0000000000) starting
[junit4] 2> 429999 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:58089_solr) [n:127.0.0.1:58089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 429999 INFO (zkCallback-1270-thread-1-processing-n:127.0.0.1:42338_solr) [n:127.0.0.1:42338_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 430009 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58089_solr
[junit4] 2> 430011 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:58089_solr) [n:127.0.0.1:58089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 430013 INFO (zkCallback-1270-thread-1-processing-n:127.0.0.1:42338_solr) [n:127.0.0.1:42338_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 430033 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 430039 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=staff, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
[junit4] 2> 430075 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 430075 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=staff, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
[junit4] 2> 430095 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 430095 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 430112 INFO (jetty-launcher-1259-thread-2-EventThread) [n:127.0.0.1:42338_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 430112 INFO (jetty-launcher-1259-thread-1-EventThread) [n:127.0.0.1:58089_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 430198 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
[junit4] 2> 430211 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
[junit4] 2> 430244 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58089.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 430246 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42338.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 430254 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58089.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 430254 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58089.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 430254 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42338.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 430254 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42338.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 430255 INFO (jetty-launcher-1259-thread-1) [n:127.0.0.1:58089_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_74DBAE9381324320-001/tempDir-001/node1/.
[junit4] 2> 430255 INFO (jetty-launcher-1259-thread-2) [n:127.0.0.1:42338_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_74DBAE9381324320-001/tempDir-001/node2/.
[junit4] 2> 430307 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 430309 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50234/solr ready
[junit4] IGNOR/A 0.00s J1 | TestImpersonationWithHadoopAuth.testForwarding
[junit4] > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/HADOOP-9893))
[junit4] 2> 430335 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 430365 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=simple-dt&e=1509776651908&s=zgXaDbZDD9jKJ82cJnXWuAanm40="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:11 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:11 GMT
[junit4] 2> 430366 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 430380 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 430388 INFO (qtp138544688-7280) [n:127.0.0.1:42338_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 430388 INFO (qtp138544688-7280) [n:127.0.0.1:42338_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 430389 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=simple-dt&e=1509776651946&s=E47ARohGqJT4ReD9iZXRq4FBq3k="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:11 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:11 GMT
[junit4] 2> 430389 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 430415 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 430417 INFO (qtp138544688-7277) [n:127.0.0.1:42338_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 430418 INFO (qtp138544688-7277) [n:127.0.0.1:42338_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 430418 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=simple-dt&e=1509776651978&s=6gUaAwTFFcqAXzpST1dXCmd0mfg="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:11 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:11 GMT
[junit4] 2> 430418 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 430433 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 430438 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=simple-dt&e=1509776651996&s=LOIo/RLIyUU+coAP0ioh0JyauCg="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:11 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:11 GMT
[junit4] 2> 430438 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 430455 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 430459 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=simple-dt&e=1509776652018&s=tD6ECarT+lHF9gibvP6XrgW/hFY="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:12 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:12 GMT
[junit4] 2> 430459 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 430482 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 430509 INFO (qtp138544688-7281) [n:127.0.0.1:42338_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 430510 INFO (qtp138544688-7281) [n:127.0.0.1:42338_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 430510 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=simple-dt&e=1509776652044&s=BY+ITVIZnqIED9wbmMmOp04Lae0="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:12 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:12 GMT
[junit4] 2> 430510 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 430525 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 446047 WARN (jetty-launcher-1259-thread-2-SendThread(127.0.0.1:50234)) [n:127.0.0.1:42338_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15790ms for sessionid 0x15f838e23020005
[junit4] 2> 446048 WARN (jetty-launcher-1259-thread-1-SendThread(127.0.0.1:50234)) [n:127.0.0.1:58089_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15829ms for sessionid 0x15f838e23020008
[junit4] 2> 446047 WARN (jetty-launcher-1259-thread-2-SendThread(127.0.0.1:50234)) [n:127.0.0.1:42338_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15828ms for sessionid 0x15f838e23020007
[junit4] 2> 446049 WARN (jetty-launcher-1259-thread-1-SendThread(127.0.0.1:50234)) [n:127.0.0.1:58089_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15793ms for sessionid 0x15f838e23020006
[junit4] 2> 446049 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f838e23020007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 446049 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f838e23020008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 446049 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f838e23020005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 446049 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f838e23020006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 446049 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=simple-dt&e=1509776652087&s=es9e0u8r5bui2RJY3DVF+w78wno="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:12 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:12 GMT
[junit4] 2> 446050 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 446071 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 446095 WARN (qtp138544688-7280) [n:127.0.0.1:42338_solr ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 446096 WARN (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[74DBAE9381324320]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=simple-dt&e=1509776667634&s=wzoMORZoLoVUP9qHNysbcFuJ9Aw="; Domain=127.0.0.1; Expires=lø, 04-nov.-2017 06:24:27 GMT; HttpOnly". Invalid 'expires' attribute: lø, 04-nov.-2017 06:24:27 GMT
[junit4] 2> 446097 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 446121 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 446123 INFO (qtp138544688-7274) [ ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
[junit4] 2> at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 446124 WARN (qtp138544688-7274) [ ] o.e.j.s.ServletHandler /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:457)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
[junit4] 2> at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
[junit4] 2> ... 26 more
[junit4] 2> 446128 INFO (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 446149 INFO (jetty-launcher-1259-thread-1-EventThread) [n:127.0.0.1:58089_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 446149 WARN (zkCallback-1271-thread-1-processing-n:127.0.0.1:58089_solr) [n:127.0.0.1:58089_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@9f98e87 name: ZooKeeperConnection Watcher:127.0.0.1:50234/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 446149 WARN (zkCallback-1271-thread-1-processing-n:127.0.0.1:58089_solr) [n:127.0.0.1:58089_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 446152 WARN (zkCallback-1270-thread-3-processing-n:127.0.0.1:42338_solr) [n:127.0.0.1:42338_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@beb8064 name: ZooKeeperConnection Watcher:127.0.0.1:50234/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 446152 WARN (zkCallback-1270-thread-3-processing-n:127.0.0.1:42338_solr) [n:127.0.0.1:42338_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 446153 INFO (jetty-closer-1260-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6697c04e{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 446153 INFO (jetty-closer-1260-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@53f1ee4{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 446154 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1463504580
[junit4] 2> 446154 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=937478441
[junit4] 2> 446154 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 446154 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4e7f0bf3: rootName = solr_42338, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@d856e0b
[junit4] 2> 446154 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 446154 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@74ae67e6: rootName = solr_58089, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1f263958
[junit4] 2> 446158 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 446158 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 446158 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3ceef51d: rootName = solr_42338, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1da2b775
[junit4] 2> 446158 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3bca103e: rootName = solr_58089, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1da2b775
[junit4] 2> 446161 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 446161 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 446161 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f4eb155: rootName = solr_58089, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@debcbff
[junit4] 2> 446161 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@11d24815: rootName = solr_42338, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@debcbff
[junit4] 2> 447387 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:58089_solr
[junit4] 2> 447388 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 447390 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 447390 INFO (jetty-closer-1260-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98942363321368582-127.0.0.1:58089_solr-n_0000000000) closing
[junit4] 2> 447390 INFO (OverseerStateUpdate-98942363321368582-127.0.0.1:58089_solr-n_0000000000) [n:127.0.0.1:58089_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:58089_solr
[junit4] 2> 447392 INFO (OverseerCollectionConfigSetProcessor-98942363321368582-127.0.0.1:58089_solr-n_0000000000) [n:127.0.0.1:58089_solr ] o.a.s.c.OverseerTaskProcessor According to ZK I (id=98942363321368582-127.0.0.1:58089_solr-n_0000000000) am no longer a leader.
[junit4] 2> 447393 WARN (OverseerAutoScalingTriggerThread-98942363321368582-127.0.0.1:58089_solr-n_0000000000) [n:127.0.0.1:58089_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 447393 INFO (zkCallback-1271-thread-3-processing-n:127.0.0.1:58089_solr) [n:127.0.0.1:58089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 447403 ERROR (Thread[Thread-2304,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:58089_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 447419 INFO (jetty-closer-1260-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@18cae014{/solr,null,UNAVAILABLE}
[junit4] 2> 447522 INFO (zkCallback-1270-thread-2-processing-n:127.0.0.1:42338_solr) [n:127.0.0.1:42338_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 447522 INFO (zkCallback-1270-thread-6-processing-n:127.0.0.1:42338_solr) [n:127.0.0.1:42338_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42338_solr
[junit4] 2> 447524 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42338_solr
[junit4] 2> 447525 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 447525 INFO (jetty-closer-1260-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 447526 INFO (zkCallback-1270-thread-6-processing-n:127.0.0.1:42338_solr) [n:127.0.0.1:42338_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 447526 ERROR (Thread[Thread-2306,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:42338_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 447545 INFO (jetty-closer-1260-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4003fba4{/solr,null,UNAVAILABLE}
[junit4] 2> 447546 ERROR (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 447547 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50234 50234
[junit4] 2> 447633 INFO (Thread-2287) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50234 50234
[junit4] 2> 447635 WARN (Thread-2287) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 447635 INFO (SUITE-TestImpersonationWithHadoopAuth-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Nov 03, 2017 8:24:29 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> Nov 03, 2017 8:24:49 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
[junit4] 2> 1) Thread[id=7317, name=jetty-launcher-1259-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Nov 03, 2017 8:24:49 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=7317, name=jetty-launcher-1259-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] 2> 467855 ERROR (jetty-launcher-1259-thread-1-EventThread) [n:127.0.0.1:58089_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Nov 03, 2017 8:24:49 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4b1b637a), locale=da, timezone=PST
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=3,threads=1,free=70192168,total=312860672
[junit4] 2> NOTE: All tests run in this JVM: [TestStressLiveNodes, ExitableDirectoryReaderTest, StatelessScriptUpdateProcessorFactoryTest, OpenExchangeRatesOrgProviderTest, HealthCheckHandlerTest, TestCustomSort, TestFoldingMultitermQuery, SolrShardReporterTest, TestSystemIdResolver, TestBulkSchemaConcurrent, SolrIndexConfigTest, TestLuceneMatchVersion, NumberUtilsTest, ReplicaListTransformerTest, TestCoreAdminApis, TestRecoveryHdfs, TestSerializedLuceneMatchVersion, SchemaVersionSpecificBehaviorTest, ChaosMonkeySafeLeaderTest, GraphQueryTest, TestDynamicFieldCollectionResource, TestSystemCollAutoCreate, TestSkipOverseerOperations, TestCorePropertiesReload, CollectionStateFormat2Test, TestSmileRequest, DeleteStatusTest, SolrGangliaReporterTest, DeleteLastCustomShardedReplicaTest, CoreSorterTest, TestWordDelimiterFilterFactory, TestAddFieldRealTimeGet, SoftAutoCommitTest, TestManagedResourceStorage, TestStandardQParsers, CoreMergeIndexesAdminHandlerTest, TestPushWriter, TestSSLRandomization, TestImpersonationWithHadoopAuth]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=74DBAE9381324320 -Dtests.slow=true -Dtests.locale=da -Dtests.timezone=PST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J1 | TestImpersonationWithHadoopAuth (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
[junit4] > 1) Thread[id=7317, name=jetty-launcher-1259-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([74DBAE9381324320]:0)
[junit4] Completed [77/747 (1!)] on J1 in 38.20s, 10 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 1667 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> 3604313 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_74DBAE9381324320-001/init-core-data-001
[junit4] 2> 3604313 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 3604313 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 3604315 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[74DBAE9381324320]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 3604345 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_74DBAE9381324320-001/tempDir-001
[junit4] 2> 3604345 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3604345 INFO (Thread-9597) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3604345 INFO (Thread-9597) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3604355 ERROR (Thread-9597) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3604445 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[74DBAE9381324320]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:50774
[junit4] 2> 3604456 INFO (jetty-launcher-5622-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3604456 INFO (jetty-launcher-5622-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27b8b3b4{/solr,null,AVAILABLE}
[junit4] 2> 3604457 INFO (jetty-launcher-5622-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@62d29685{HTTP/1.1,[http/1.1]}{127.0.0.1:63202}
[junit4] 2> 3604457 INFO (jetty-launcher-5622-thread-2) [ ] o.e.j.s.Server Started @3606681ms
[junit4] 2> 3604457 INFO (jetty-launcher-5622-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63202}
[junit4] 2> 3604457 ERROR (jetty-launcher-5622-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3604457 INFO (jetty-launcher-5622-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3604457 INFO (jetty-launcher-5622-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3604457 INFO (jetty-launcher-5622-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3604457 INFO (jetty-launcher-5622-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T21:17:06.018Z
[junit4] 2> 3604462 INFO (jetty-launcher-5622-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3604463 INFO (jetty-launcher-5622-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45ca5572{/solr,null,AVAILABLE}
[junit4] 2> 3604463 INFO (jetty-launcher-5622-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6a42285e{HTTP/1.1,[http/1.1]}{127.0.0.1:33611}
[junit4] 2> 3604463 INFO (jetty-launcher-5622-thread-1) [ ] o.e.j.s.Server Started @3606687ms
[junit4] 2> 3604463 INFO (jetty-launcher-5622-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3604463 INFO (jetty-launcher-5622-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33611}
[junit4] 2> 3604466 ERROR (jetty-launcher-5622-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3604466 INFO (jetty-launcher-5622-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3604466 INFO (jetty-launcher-5622-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3604466 INFO (jetty-launcher-5622-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3604466 INFO (jetty-launcher-5622-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T21:17:06.027Z
[junit4] 2> 3604468 INFO (jetty-launcher-5622-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3604474 INFO (jetty-launcher-5622-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50774/solr
[junit4] 2> 3604514 INFO (jetty-launcher-5622-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50774/solr
[junit4] 2> 3604645 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3604645 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3604646 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33611_solr
[junit4] 2> 3604646 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63202_solr
[junit4] 2> 3604649 INFO (zkCallback-5632-thread-1-processing-n:127.0.0.1:63202_solr) [n:127.0.0.1:63202_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3604649 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.Overseer Overseer (id=98942571375230982-127.0.0.1:33611_solr-n_0000000000) starting
[junit4] 2> 3604652 INFO (zkCallback-5634-thread-1-processing-n:127.0.0.1:33611_solr) [n:127.0.0.1:33611_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3604674 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33611_solr
[junit4] 2> 3604679 INFO (zkCallback-5634-thread-1-processing-n:127.0.0.1:33611_solr) [n:127.0.0.1:33611_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3604680 INFO (zkCallback-5632-thread-1-processing-n:127.0.0.1:63202_solr) [n:127.0.0.1:63202_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3604696 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 3604697 WARN (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3604700 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 3604704 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 3604706 INFO (jetty-launcher-5622-thread-2-EventThread) [n:127.0.0.1:63202_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 3604721 WARN (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3604738 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 3604738 WARN (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3604739 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 3604740 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 3604742 INFO (jetty-launcher-5622-thread-1-EventThread) [n:127.0.0.1:33611_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 3604757 WARN (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3604770 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63202.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 3604780 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63202.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 3604780 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63202.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 3604781 INFO (jetty-launcher-5622-thread-2) [n:127.0.0.1:63202_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_74DBAE9381324320-001/tempDir-001/node2/.
[junit4] 2> 3604795 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33611.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 3604800 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33611.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 3604800 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33611.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 3604800 INFO (jetty-launcher-5622-thread-1) [n:127.0.0.1:33611_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_74DBAE9381324320-001/tempDir-001/node1/.
[junit4] 2> 3604952 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 3604959 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 3605094 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 3605114 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 3605252 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 3605252 INFO (qtp836174049-35774) [n:127.0.0.1:63202_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3605253 INFO (qtp836174049-35774) [n:127.0.0.1:63202_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3605253 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 3605382 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 3605383 INFO (qtp836174049-35775) [n:127.0.0.1:63202_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3605383 INFO (qtp836174049-35775) [n:127.0.0.1:63202_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3605383 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 3605515 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[74DBAE9381324320]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 3605993 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[74DBAE9381324320]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3605994 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[74DBAE9381324320]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50774/solr ready
[junit4] 2> 3605996 INFO (qtp1650115688-35783) [n:127.0.0.1:33611_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3605998 INFO (OverseerThreadFactory-12748-thread-1-processing-n:127.0.0.1:33611_solr) [n:127.0.0.1:33611_solr ] o.a.s.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 3606117 INFO (OverseerStateUpdate-98942571375230982-127.0.0.1:33611_solr-n_0000000000) [n:127.0.0.1:33611_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33611/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3606328 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3606329 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3606439 INFO (zkCallback-5634-thread-1-processing-n:127.0.0.1:33611_solr) [n:127.0.0.1:33611_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3606439 INFO (zkCallback-5634-thread-2-processing-n:127.0.0.1:33611_solr) [n:127.0.0.1:33611_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3607370 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3607401 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 3607497 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3607516 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 3607517 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33611.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fef1f6
[junit4] 2> 3607517 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3607517 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_74DBAE9381324320-001/tempDir-001/node1/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_74DBAE9381324320-001/tempDir-001/node1/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 3607518 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1734098045, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 3607562 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3607562 INFO (qtp1650115688-35782) [n:127.0.0.1:33611_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog
[...truncated too long message...]
stImpersonationWithHadoopAuth, TestCollationField, FileUtilsTest, SolrCoreTest, TestHashPartitioner, DistributedFacetPivotWhiteBoxTest, TestCSVLoader, TestLegacyFieldCache, TestPointFields, CollectionsAPIAsyncDistributedZkTest, DistributedIntervalFacetingTest, LeaderFailureAfterFreshStartTest, PingRequestHandlerTest, ZkStateWriterTest, TestReload, DebugComponentTest, TestDistribIDF, TestIntervalFaceting, DistributedFacetPivotSmallAdvancedTest, TestNumericTerms64, HLLUtilTest, JSONWriterTest, TestPayloadCheckQParserPlugin, FacetPivotSmallTest, ZkSolrClientTest, TestComponentsName, DocValuesMissingTest, DistributedExpandComponentTest, TestNonDefinedSimilarityFactory, HdfsWriteToMultipleCollectionsTest, TestCloudRecovery, TestReqParamsAPI, ShardRoutingCustomTest, TestBlendedInfixSuggestions, TestConfigSetProperties, BasicZkTest, CdcrReplicationDistributedZkTest, SSLMigrationTest, TestSubQueryTransformerDistrib, PeerSyncWithIndexFingerprintCachingTest, TestScoreJoinQPScore, DistribDocExpirationUpdateProcessorTest, TestRTGBase, TestUnifiedSolrHighlighter, TestNumericTokenStream, AnalysisAfterCoreReloadTest, LoggingHandlerTest, TestLMJelinekMercerSimilarityFactory, TestBadConfig, ChaosMonkeyNothingIsSafeWithPullReplicasTest, SampleTest, SOLR749Test, RankQueryTest, OutOfBoxZkACLAndCredentialsProvidersTest, LeaderElectionContextKeyTest, MissingSegmentRecoveryTest, SystemLogListenerTest, CacheHeaderTest, SolrCoreMetricManagerTest, JvmMetricsTest, JavabinLoaderTest, BasicFunctionalityTest, TestXmlQParserPlugin, TestNestedDocsSort, TestLeaderInitiatedRecoveryThread, SolrIndexSplitterTest, CloudExitableDirectoryReaderTest, FullHLLTest, TestSolrCLIRunExample, CachingDirectoryFactoryTest, TestMissingGroups, DocExpirationUpdateProcessorFactoryTest, ZkNodePropsTest, TestFieldCacheVsDocValues, TestClassicSimilarityFactory, TestFastWriter, TestFastLRUCache, TriggerIntegrationTest, TestPartialUpdateDeduplication, DocValuesNotIndexedTest, TestFunctionQuery, TestMergePolicyConfig, TestRebalanceLeaders, HdfsBasicDistributedZkTest, TestElisionMultitermQuery, CopyFieldTest, BasicAuthIntegrationTest, OpenCloseCoreStressTest, TestBinaryResponseWriter, TestSolrConfigHandler, TestPKIAuthenticationPlugin, TestTrie, QueryElevationComponentTest, TestBlobHandler, VMParamsZkACLAndCredentialsProvidersTest, BlobRepositoryCloudTest, CollectionsAPIDistributedZkTest, TestHdfsUpdateLog, BlockJoinFacetRandomTest, TestZkAclsWithHadoopAuth, ConcurrentDeleteAndCreateCollectionTest, OverseerTaskQueueTest, DirectSolrSpellCheckerTest, TestUseDocValuesAsStored2, AnalyticsQueryTest, TestCloudSchemaless, SubstringBytesRefFilterTest, CheckHdfsIndexTest, TestLegacyNumericRangeQueryBuilder, TestFilteredDocIdSet, VersionInfoTest, TestJettySolrRunner, MBeansHandlerTest, SpellCheckCollatorWithCollapseTest, HdfsTlogReplayBufferedWhileIndexingTest, TestAuthenticationFramework, TestCloudPivotFacet, TestShardHandlerFactory, TestSolrCloudSnapshots, ResponseHeaderTest, TestDocBasedVersionConstraints, SolrMetricReporterTest, ManagedSchemaRoundRobinCloudTest, TestManagedSchemaAPI, PeerSyncTest, PluginInfoTest, TestSha256AuthenticationProvider, TestDistributedMissingSort, BufferStoreTest, TestCryptoKeys, TestTolerantUpdateProcessorCloud, TestFaceting, ActionThrottleTest, TestStressLucene, SolrJmxReporterCloudTest, TestValueSourceCache, AddBlockUpdateTest, TestQueryWrapperFilter, RuleEngineTest, TestConfigSetsAPIExclusivity, TestCoreContainer, TestSolrQueryResponse, TestExtendedDismaxParser, BasicDistributedZk2Test, LeaderElectionIntegrationTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, TestDistributedSearch, TestDistributedGrouping, TestRecovery, TermVectorComponentDistributedTest, TestRealTimeGet, TestStressReorder, TestJoin, TestStressVersions, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, TestSolr4Spatial, StatsComponentTest, SpellCheckComponentTest, TestGroupingSearch, BadIndexSchemaTest, TestSort, TestFiltering, DirectUpdateHandlerTest, TestIndexSearcher, HighlighterTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesTest, SuggesterTSTTest, SuggesterTest, SuggesterWFSTTest, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, TestSurroundQueryParser, LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestAnalyzedSuggestions, JsonLoaderTest, TestPHPSerializedResponseWriter, SearchHandlerTest, TestLFUCache, TestQuerySenderListener, UpdateParamsTest, TestSolrIndexConfig, ResponseLogComponentTest, BadComponentTest, MultiTermTest, TestDocSet, TestSearchPerf, MinimalSchemaTest, TestConfig, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestIBSimilarityFactory, TestBM25SimilarityFactory, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, ScriptEngineTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestDocumentBuilder, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestSimpleTrackingShardHandler, TestLuceneIndexBackCompat, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, AddReplicaTest, AliasIntegrationTest, AssignTest, BaseCdcrDistributedZkTest, CdcrBootstrapTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, CleanupOldIndexTest, CollectionTooManyReplicasTest, ConfigSetsAPITest, ConnectionManagerTest, CustomCollectionTest, DeleteNodeTest, DeleteReplicaTest, ForceLeaderTest, MultiThreadedOCPTest, OverseerRolesTest, PeerSyncReplicationTest, ReplaceNodeTest, SimpleCollectionCreateDeleteTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, SolrXmlInZkTest, TestCloudDeleteByQuery, TestCloudInspectUtil, TestCloudSearcherWarming, TestClusterProperties, TestCollectionsAPIViaSolrCloudCluster, TestDeleteCollectionOnDownNodes, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestHdfsCloudBackupRestore, TestLeaderElectionZkExpiry, TestOnReconnectListenerSupport, TestPrepRecovery, TestPullReplicaErrorHandling, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=74DBAE9381324320 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=Pacific/Funafuti -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=35816, name=jetty-launcher-5622-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([74DBAE9381324320]:0)
[junit4] Completed [572/747 (2!)] on J1 in 48.50s, 12 tests, 1 error <<< FAILURES!
[...truncated 47833 lines...]
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build #
1509 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1509/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:39388_solr, 127.0.0.1:40952_solr] Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/23)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testSimple1_shard1_replica_n1", "base_url":"http://127.0.0.1:34157/solr", "node_name":"127.0.0.1:34157_solr", "state":"down", "type":"NRT"}, "core_node12":{ "core":"testSimple1_shard1_replica_n11", "base_url":"http://127.0.0.1:39388/solr", "node_name":"127.0.0.1:39388_solr", "state":"active", "type":"NRT", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node7":{ "core":"testSimple1_shard2_replica_n4", "base_url":"http://127.0.0.1:34157/solr", "node_name":"127.0.0.1:34157_solr", "state":"down", "type":"NRT"}, "core_node10":{ "core":"testSimple1_shard2_replica_n9", "base_url":"http://127.0.0.1:39388/solr", "node_name":"127.0.0.1:39388_solr", "state":"active", "type":"NRT", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"true", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:39388_solr, 127.0.0.1:40952_solr]
Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/23)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testSimple1_shard1_replica_n1",
"base_url":"http://127.0.0.1:34157/solr",
"node_name":"127.0.0.1:34157_solr",
"state":"down",
"type":"NRT"},
"core_node12":{
"core":"testSimple1_shard1_replica_n11",
"base_url":"http://127.0.0.1:39388/solr",
"node_name":"127.0.0.1:39388_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node7":{
"core":"testSimple1_shard2_replica_n4",
"base_url":"http://127.0.0.1:34157/solr",
"node_name":"127.0.0.1:34157_solr",
"state":"down",
"type":"NRT"},
"core_node10":{
"core":"testSimple1_shard2_replica_n9",
"base_url":"http://127.0.0.1:39388/solr",
"node_name":"127.0.0.1:39388_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"true",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([9A9D8E2EDD50D0F5:A22EAAD0FAA30424]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:124)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11659 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/init-core-data-001
[junit4] 2> 54174 WARN (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=19 numCloses=19
[junit4] 2> 54174 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 54176 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 54176 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 54177 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001
[junit4] 2> 54178 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 54178 INFO (Thread-129) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 54178 INFO (Thread-129) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 54181 ERROR (Thread-129) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 54278 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46582
[junit4] 2> 54286 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 54291 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ac6095b{/solr,null,AVAILABLE}
[junit4] 2> 54298 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@98f968b{HTTP/1.1,[http/1.1]}{127.0.0.1:34157}
[junit4] 2> 54298 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.Server Started @56310ms
[junit4] 2> 54298 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34157}
[junit4] 2> 54298 ERROR (jetty-launcher-701-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 54298 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 54298 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 54298 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 54298 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T10:49:09.392Z
[junit4] 2> 54305 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 54307 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 54312 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e6c263b{/solr,null,AVAILABLE}
[junit4] 2> 54314 INFO (jetty-launcher-701-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 54317 INFO (jetty-launcher-701-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d508f54{/solr,null,AVAILABLE}
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@15dd427d{HTTP/1.1,[http/1.1]}{127.0.0.1:39388}
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7be2c693{HTTP/1.1,[http/1.1]}{127.0.0.1:40952}
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-3) [ ] o.e.j.s.Server Started @56330ms
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40952}
[junit4] 2> 54318 ERROR (jetty-launcher-701-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 54318 INFO (jetty-launcher-701-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T10:49:09.412Z
[junit4] 2> 54333 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.Server Started @56330ms
[junit4] 2> 54333 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39388}
[junit4] 2> 54333 ERROR (jetty-launcher-701-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 54333 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 54333 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 54333 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 54333 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-03T10:49:09.427Z
[junit4] 2> 54348 INFO (jetty-launcher-701-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 54354 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46582/solr
[junit4] 2> 54354 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 54358 INFO (jetty-launcher-701-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46582/solr
[junit4] 2> 54377 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46582/solr
[junit4] 2> 54502 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 54503 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39388_solr
[junit4] 2> 54504 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:34157_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 54505 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.c.Overseer Overseer (id=98940102198755337-127.0.0.1:39388_solr-n_0000000000) starting
[junit4] 2> 54509 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:34157_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34157_solr
[junit4] 2> 54528 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 54528 INFO (zkCallback-718-thread-1-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 54536 INFO (jetty-launcher-701-thread-3) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 54540 DEBUG (OverseerAutoScalingTriggerThread-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 54541 INFO (jetty-launcher-701-thread-3) [n:127.0.0.1:40952_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 54545 DEBUG (OverseerAutoScalingTriggerThread-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 54546 INFO (jetty-launcher-701-thread-3) [n:127.0.0.1:40952_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40952_solr
[junit4] 2> 54582 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 54582 INFO (zkCallback-713-thread-1-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 54592 DEBUG (OverseerAutoScalingTriggerThread-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:34157_solr]
[junit4] 2> 54592 DEBUG (OverseerAutoScalingTriggerThread-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 54592 DEBUG (OverseerAutoScalingTriggerThread-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 54592 INFO (zkCallback-718-thread-1-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 54592 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39388_solr
[junit4] 2> 54603 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 54603 INFO (zkCallback-713-thread-1-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 54613 INFO (zkCallback-718-thread-1-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 54644 DEBUG (OverseerAutoScalingTriggerThread-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 54644 DEBUG (OverseerAutoScalingTriggerThread-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 54644 DEBUG (ScheduledTrigger-545-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34157_solr, 127.0.0.1:40952_solr, 127.0.0.1:39388_solr]
[junit4] 2> 54718 INFO (jetty-launcher-701-thread-3) [n:127.0.0.1:40952_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40952.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54723 INFO (jetty-launcher-701-thread-3) [n:127.0.0.1:40952_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40952.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54723 INFO (jetty-launcher-701-thread-3) [n:127.0.0.1:40952_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40952.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54724 INFO (jetty-launcher-701-thread-3) [n:127.0.0.1:40952_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node3/.
[junit4] 2> 54787 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:34157_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34157.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54792 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:34157_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34157.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54792 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:34157_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34157.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54793 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:34157_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/.
[junit4] 2> 54842 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39388.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54851 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39388.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54851 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39388.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 54852 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node1/.
[junit4] 2> 54877 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f817fad99000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 54881 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 54882 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46582/solr ready
[junit4] 2> 54907 INFO (TEST-AutoAddReplicasIntegrationTest.testSimple-seed#[9A9D8E2EDD50D0F5]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
[junit4] 2> 54921 INFO (qtp461875672-2770) [n:127.0.0.1:34157_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:40952_solr,127.0.0.1:34157_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 54943 INFO (OverseerThreadFactory-547-thread-1-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.CreateCollectionCmd Create collection testSimple1
[junit4] 2> 55075 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34157/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 55080 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40952/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 55084 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34157/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 55087 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40952/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 55298 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 55298 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 55300 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 55301 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 55301 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 55306 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 55429 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 55430 INFO (zkCallback-713-thread-1-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 55431 INFO (zkCallback-714-thread-2-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 55432 INFO (zkCallback-713-thread-2-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 55647 DEBUG (ScheduledTrigger-545-thread-1) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34157_solr, 127.0.0.1:40952_solr, 127.0.0.1:39388_solr]
[junit4] 2> 56370 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 56377 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 56378 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 56380 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 56380 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
[junit4] 2> 56382 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34157.solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 56382 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 56382 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/testSimple1_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/./testSimple1_shard1_replica_n1/data/]
[junit4] 2> 56405 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 56419 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 56425 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
[junit4] 2> 56426 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 56426 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
[junit4] 2> 56427 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34157.solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 56427 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 56427 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/testSimple1_shard2_replica_n4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/./testSimple1_shard2_replica_n4/data/]
[junit4] 2> 56444 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
[junit4] 2> 56446 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 56446 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
[junit4] 2> 56446 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40952.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 56447 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 56447 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node3/testSimple1_shard2_replica_n6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node3/./testSimple1_shard2_replica_n6/data/]
[junit4] 2> 56478 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 56478 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 56480 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 56480 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 56480 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
[junit4] 2> 56481 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3494d4d7[testSimple1_shard1_replica_n1] main]
[junit4] 2> 56483 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 56483 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
[junit4] 2> 56483 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40952.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 56484 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 56484 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node3/testSimple1_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node3/./testSimple1_shard1_replica_n2/data/]
[junit4] 2> 56528 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 56528 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 56530 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 56530 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 56549 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 56549 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 56551 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 56551 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 56553 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@329595f7[testSimple1_shard2_replica_n6] main]
[junit4] 2> 56554 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5a9852ab[testSimple1_shard1_replica_n2] main]
[junit4] 2> 56578 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 56578 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 56580 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 56580 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 56588 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 56589 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 56590 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 56592 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041637710299136
[junit4] 2> 56598 INFO (searcherExecutor-554-thread-1-processing-n:127.0.0.1:34157_solr x:testSimple1_shard1_replica_n1 s:shard1 c:testSimple1 r:core_node3) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [testSimple1_shard1_replica_n1] Registered new searcher Searcher@3494d4d7[testSimple1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 56604 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@597eb9f6[testSimple1_shard2_replica_n4] main]
[junit4] 2> 56638 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 56698 DEBUG (ScheduledTrigger-545-thread-2) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34157_solr, 127.0.0.1:40952_solr, 127.0.0.1:39388_solr]
[junit4] 2> 56699 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 56699 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 56700 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 56700 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 56700 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 56700 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9938ms
[junit4] 2> 56701 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041637824593920
[junit4] 2> 56701 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 56701 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041637824593920
[junit4] 2> 56702 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 56709 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 56709 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041637832982528
[junit4] 2> 56729 INFO (searcherExecutor-556-thread-1-processing-n:127.0.0.1:34157_solr x:testSimple1_shard2_replica_n4 s:shard2 c:testSimple1 r:core_node7) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [testSimple1_shard2_replica_n4] Registered new searcher Searcher@597eb9f6[testSimple1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 56730 INFO (searcherExecutor-557-thread-1-processing-n:127.0.0.1:40952_solr x:testSimple1_shard2_replica_n6 s:shard2 c:testSimple1 r:core_node8) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [testSimple1_shard2_replica_n6] Registered new searcher Searcher@329595f7[testSimple1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 56730 INFO (searcherExecutor-561-thread-1-processing-n:127.0.0.1:40952_solr x:testSimple1_shard1_replica_n2 s:shard1 c:testSimple1 r:core_node5) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [testSimple1_shard1_replica_n2] Registered new searcher Searcher@5a9852ab[testSimple1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 56734 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 56836 INFO (zkCallback-713-thread-1-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 56836 INFO (zkCallback-713-thread-2-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 56838 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 56838 INFO (zkCallback-714-thread-2-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57202 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 57202 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 57202 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34157/solr/testSimple1_shard1_replica_n1/
[junit4] 2> 57214 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=http://127.0.0.1:34157/solr START replicas=[http://127.0.0.1:40952/solr/testSimple1_shard1_replica_n2/] nUpdates=100
[junit4] 2> 57225 INFO (qtp448906520-2792) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.S.Request [testSimple1_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 57237 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 57237 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 57237 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34157/solr/testSimple1_shard2_replica_n4/
[junit4] 2> 57238 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n4 url=http://127.0.0.1:34157/solr START replicas=[http://127.0.0.1:40952/solr/testSimple1_shard2_replica_n6/] nUpdates=100
[junit4] 2> 57242 INFO (qtp448906520-2789) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.S.Request [testSimple1_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 57515 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=http://127.0.0.1:34157/solr DONE. We have no versions. sync failed.
[junit4] 2> 57516 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 57516 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 57516 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 57537 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34157/solr/testSimple1_shard1_replica_n1/ shard1
[junit4] 2> 57539 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n4 url=http://127.0.0.1:34157/solr DONE. We have no versions. sync failed.
[junit4] 2> 57539 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 57539 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 57540 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 57548 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34157/solr/testSimple1_shard2_replica_n4/ shard2
[junit4] 2> 57650 INFO (zkCallback-713-thread-2-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57650 INFO (zkCallback-713-thread-1-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57651 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57651 INFO (zkCallback-714-thread-2-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57654 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 57657 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2356
[junit4] 2> 57694 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 57697 INFO (qtp461875672-2764) [n:127.0.0.1:34157_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2399
[junit4] 2> 57699 DEBUG (ScheduledTrigger-545-thread-2) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34157_solr, 127.0.0.1:40952_solr, 127.0.0.1:39388_solr]
[junit4] 2> 57746 INFO (qtp448906520-2785) [n:127.0.0.1:40952_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2448
[junit4] 2> 57749 INFO (qtp448906520-2787) [n:127.0.0.1:40952_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2448
[junit4] 2> 57775 INFO (qtp461875672-2770) [n:127.0.0.1:34157_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 57851 INFO (zkCallback-714-thread-2-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57851 INFO (zkCallback-713-thread-1-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57851 INFO (zkCallback-713-thread-2-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57851 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 58703 DEBUG (ScheduledTrigger-545-thread-2) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34157_solr, 127.0.0.1:40952_solr, 127.0.0.1:39388_solr]
[junit4] 2> 58775 INFO (qtp461875672-2770) [n:127.0.0.1:34157_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:40952_solr,127.0.0.1:34157_solr&wt=javabin&version=2} status=0 QTime=3854
[junit4] 2> 58778 INFO (qtp461875672-2766) [n:127.0.0.1:34157_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:34157_solr,127.0.0.1:39388_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 58785 INFO (OverseerCollectionConfigSetProcessor-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 58787 INFO (OverseerThreadFactory-547-thread-2-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.CreateCollectionCmd Create collection testSimple2
[junit4] 2> 59011 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34157/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 59016 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39388/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 59018 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple2_shard2_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34157/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 59023 INFO (OverseerStateUpdate-98940102198755337-127.0.0.1:39388_solr-n_0000000000) [n:127.0.0.1:39388_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple2_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39388/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 59220 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n3&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 59222 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 59223 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 59228 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 59229 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 59342 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 59342 INFO (zkCallback-718-thread-1-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 59342 INFO (zkCallback-714-thread-2-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 59343 INFO (zkCallback-718-thread-2-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 59704 DEBUG (ScheduledTrigger-545-thread-2) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34157_solr, 127.0.0.1:40952_solr, 127.0.0.1:39388_solr]
[junit4] 2> 60250 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 60257 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 60287 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 60290 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n1] Schema name=minimal
[junit4] 2> 60290 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 60293 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n2] Schema name=minimal
[junit4] 2> 60293 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 60294 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n1' using configuration from collection testSimple2, trusted=true
[junit4] 2> 60294 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34157.solr.core.testSimple2.shard1.replica_n1' (registry 'solr.core.testSimple2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 60294 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 60294 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/testSimple2_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/./testSimple2_shard1_replica_n1/data/]
[junit4] 2> 60295 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 60295 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n2' using configuration from collection testSimple2, trusted=true
[junit4] 2> 60295 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39388.solr.core.testSimple2.shard1.replica_n2' (registry 'solr.core.testSimple2.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 60295 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 60295 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node1/testSimple2_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node1/./testSimple2_shard1_replica_n2/data/]
[junit4] 2> 60296 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple2_shard2_replica_n4] Schema name=minimal
[junit4] 2> 60298 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 60298 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard2_replica_n4' using configuration from collection testSimple2, trusted=true
[junit4] 2> 60298 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39388.solr.core.testSimple2.shard2.replica_n4' (registry 'solr.core.testSimple2.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 60298 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 60298 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple2_shard2_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node1/testSimple2_shard2_replica_n4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node1/./testSimple2_shard2_replica_n4/data/]
[junit4] 2> 60310 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.s.IndexSchema [testSimple2_shard2_replica_n3] Schema name=minimal
[junit4] 2> 60312 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 60312 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard2_replica_n3' using configuration from collection testSimple2, trusted=true
[junit4] 2> 60312 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34157.solr.core.testSimple2.shard2.replica_n3' (registry 'solr.core.testSimple2.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e91479b
[junit4] 2> 60312 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 60312 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.c.SolrCore [[testSimple2_shard2_replica_n3] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/testSimple2_shard2_replica_n3], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001/tempDir-001/node2/./testSimple2_shard2_replica_n3/data/]
[junit4] 2> 60351 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 60351 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 60351 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 60351 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 60353 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 60353 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 60353 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 60353 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 60354 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@267b46c5[testSimple2_shard2_replica_n4] main]
[junit4] 2> 60354 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b6df7a3[testSimple2_shard1_replica_n2] main]
[junit4] 2> 60355 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 60356 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 60356 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 60357 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041641658187776
[junit4] 2> 60362 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 60363 INFO (searcherExecutor-576-thread-1-processing-n:127.0.0.1:39388_solr x:testSimple2_shard2_replica_n4 s:shard2 c:testSimple2 r:core_node8) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrCore [testSimple2_shard2_replica_n4] Registered new searcher Searcher@267b46c5[testSimple2_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 60364 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 60364 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 60364 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 60365 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041641666576384
[junit4] 2> 60367 INFO (searcherExecutor-575-thread-1-processing-n:127.0.0.1:39388_solr x:testSimple2_shard1_replica_n2 s:shard1 c:testSimple2 r:core_node6) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [testSimple2_shard1_replica_n2] Registered new searcher Searcher@1b6df7a3[testSimple2_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 60371 INFO (qtp1061074310-2778) [n:127.0.0.1:39388_solr c:testSimple2 s:shard1 r:core_node6 x:testSimple2_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 60383 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 60383 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 60385 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 60385 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 60386 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7c4ee0dc[testSimple2_shard1_replica_n1] main]
[junit4] 2> 60387 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 60387 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 60388 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 60389 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 60389 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 60389 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 60389 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 60389 INFO (qtp461875672-2771) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041641691742208
[junit4] 2> 60391 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@318a5f31[testSimple2_shard2_replica_n3] main]
[junit4] 2> 60392 INFO (searcherExecutor-574-thread-1-processing-n:127.0.0.1:34157_solr x:testSimple2_shard1_replica_n1 s:shard1 c:testSimple2 r:core_node5) [n:127.0.0.1:34157_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [testSimple2_shard1_replica_n1] Registered new searcher Searcher@7c4ee0dc[testSimple2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 60393 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 60393 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 60394 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 60395 INFO (searcherExecutor-577-thread-1-processing-n:127.0.0.1:34157_solr x:testSimple2_shard2_replica_n3 s:shard2 c:testSimple2 r:core_node7) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.c.SolrCore [testSimple2_shard2_replica_n3] Registered new searcher Searcher@318a5f31[testSimple2_shard2_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 60395 INFO (qtp461875672-2767) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583041641698033664
[junit4] 2> 60474 INFO (zkCallback-718-thread-2-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 60474 INFO (zkCallback-718-thread-3-processing-n:127.0.0.1:39388_solr) [n:127.0.0.1:39388_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 60475 INFO (zkCallback-714-thread-1-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 60475 INFO (zkCallback-714-thread-2-processing-n:127.0.0.1:34157_solr) [n:127.0.0.1:34157_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 60704 DEBUG (ScheduledTrigger-545-thread-2) [n:127.0.0.1:39388_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34157_solr, 127.0.0.1:40952_solr, 127.0.0.1:39388_solr]
[junit4] 2> 60864 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 60864 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 60864 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39388/solr/testSimple2_shard2_replica_n4/
[junit4] 2> 60864 INFO (qtp1061074310-2777) [n:127.0.0.1:39388_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard2_replica_n4 url=http://127.0.0.1:39388/solr START replicas=[http://127.0.0.1:34157/solr/testSimple2_shard2_replica_n3/] nUpdates=100
[junit4] 2> 60870 INFO (qtp461875672-2768) [n:127.0.0.1:34157_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n3] o.a.s.c.S.Request [testSimple2_shard2_replica_n3] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 60873 INFO (qtp1061074310-2778) [n:127.0.0.1:
[...truncated too long message...]
2> 205826 DEBUG (ScheduledTrigger-677-thread-1) [n:127.0.0.1:40952_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: []
[junit4] 2> 206653 INFO (recoveryExecutor-731-thread-1-processing-x:testSimple2_shard1_replica_n11 r:core_node12 .auto_add_replicas//14f38dcbd82db600Tbt4engsi81pcr62gcqcegmy4k//01035965907261606 CREATE n:127.0.0.1:40952_solr s:shard1 c:testSimple2) [n:127.0.0.1:40952_solr c:testSimple2 s:shard1 r:core_node12 x:testSimple2_shard1_replica_n11] o.a.s.c.RecoveryStrategy RecoveryStrategy has been closed
[junit4] 2> 206653 INFO (recoveryExecutor-731-thread-1-processing-x:testSimple2_shard1_replica_n11 r:core_node12 .auto_add_replicas//14f38dcbd82db600Tbt4engsi81pcr62gcqcegmy4k//01035965907261606 CREATE n:127.0.0.1:40952_solr s:shard1 c:testSimple2) [n:127.0.0.1:40952_solr c:testSimple2 s:shard1 r:core_node12 x:testSimple2_shard1_replica_n11] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[false]
[junit4] 2> 206653 INFO (recoveryExecutor-731-thread-1-processing-x:testSimple2_shard1_replica_n11 r:core_node12 .auto_add_replicas//14f38dcbd82db600Tbt4engsi81pcr62gcqcegmy4k//01035965907261606 CREATE n:127.0.0.1:40952_solr s:shard1 c:testSimple2) [n:127.0.0.1:40952_solr c:testSimple2 s:shard1 r:core_node12 x:testSimple2_shard1_replica_n11] o.a.s.c.SolrCore [testSimple2_shard1_replica_n11] CLOSING SolrCore org.apache.solr.core.SolrCore@71344187
[junit4] 2> 206654 INFO (recoveryExecutor-731-thread-1-processing-x:testSimple2_shard1_replica_n11 r:core_node12 .auto_add_replicas//14f38dcbd82db600Tbt4engsi81pcr62gcqcegmy4k//01035965907261606 CREATE n:127.0.0.1:40952_solr s:shard1 c:testSimple2) [n:127.0.0.1:40952_solr c:testSimple2 s:shard1 r:core_node12 x:testSimple2_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple2.shard1.replica_n11, tag=1899250055
[junit4] 2> 206654 INFO (recoveryExecutor-731-thread-1-processing-x:testSimple2_shard1_replica_n11 r:core_node12 .auto_add_replicas//14f38dcbd82db600Tbt4engsi81pcr62gcqcegmy4k//01035965907261606 CREATE n:127.0.0.1:40952_solr s:shard1 c:testSimple2) [n:127.0.0.1:40952_solr c:testSimple2 s:shard1 r:core_node12 x:testSimple2_shard1_replica_n11] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15435c57: rootName = solr_40952, domain = solr.core.testSimple2.shard1.replica_n11, service url = null, agent id = null] for registry solr.core.testSimple2.shard1.replica_n11 / com.codahale.metrics.MetricRegistry@5065c7ea
[junit4] 2> 206668 INFO (recoveryExecutor-731-thread-1-processing-x:testSimple2_shard1_replica_n11 r:core_node12 .auto_add_replicas//14f38dcbd82db600Tbt4engsi81pcr62gcqcegmy4k//01035965907261606 CREATE n:127.0.0.1:40952_solr s:shard1 c:testSimple2) [n:127.0.0.1:40952_solr c:testSimple2 s:shard1 r:core_node12 x:testSimple2_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard1.leader, tag=1899250055
[junit4] 2> 206669 WARN (recoveryExecutor-731-thread-1-processing-x:testSimple2_shard1_replica_n11 r:core_node12 .auto_add_replicas//14f38dcbd82db600Tbt4engsi81pcr62gcqcegmy4k//01035965907261606 CREATE n:127.0.0.1:40952_solr s:shard1 c:testSimple2) [n:127.0.0.1:40952_solr c:testSimple2 s:shard1 r:core_node12 x:testSimple2_shard1_replica_n11] o.a.s.c.RecoveryStrategy Stopping recovery for core=[testSimple2_shard1_replica_n11] coreNodeName=[core_node12]
[junit4] 2> 206677 INFO (jetty-closer-702-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98940102198755342-127.0.0.1:40952_solr-n_0000000003) closing
[junit4] 2> 206678 INFO (OverseerStateUpdate-98940102198755342-127.0.0.1:40952_solr-n_0000000003) [n:127.0.0.1:40952_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40952_solr
[junit4] 2> 206830 DEBUG (ScheduledTrigger-677-thread-1) [n:127.0.0.1:40952_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: []
[junit4] 2> 206904 ERROR (OverseerThreadFactory-679-thread-2-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: testSimple2 operation: movereplica failed:java.lang.InterruptedException: org.apache.solr.cloud.OverseerCollectionMessageHandler@9394eb5 has been closed.
[junit4] 2> at org.apache.solr.common.SolrCloseableLatch.await(SolrCloseableLatch.java:51)
[junit4] 2> at org.apache.solr.cloud.MoveReplicaCmd.moveNormalReplica(MoveReplicaCmd.java:220)
[junit4] 2> at org.apache.solr.cloud.MoveReplicaCmd.moveReplica(MoveReplicaCmd.java:118)
[junit4] 2> at org.apache.solr.cloud.MoveReplicaCmd.call(MoveReplicaCmd.java:61)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 206926 INFO (OverseerThreadFactory-679-thread-2-processing-n:127.0.0.1:40952_solr) [n:127.0.0.1:40952_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000011 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 206927 WARN (OverseerAutoScalingTriggerThread-98940102198755342-127.0.0.1:40952_solr-n_0000000003) [n:127.0.0.1:40952_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 206929 DEBUG (jetty-closer-702-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 206936 INFO (jetty-closer-702-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@340b2eeb{/solr,null,UNAVAILABLE}
[junit4] 2> 206939 ERROR (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 206939 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9A9D8E2EDD50D0F5]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46582 46582
[junit4] 2> 207000 INFO (Thread-129) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46582 46582
[junit4] 2> 207001 WARN (Thread-129) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 52 /solr/collections/testSimple1/state.json
[junit4] 2> 46 /solr/collections/testSimple2/state.json
[junit4] 2> 13 /solr/collections/testSimple3/state.json
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 3 /solr/collections/testSimple1/leader_elect/shard2/election/98940102198755335-core_node7-n_0000000000
[junit4] 2> 3 /solr/autoscaling.json
[junit4] 2> 3 /solr/collections/testSimple1/leader_elect/shard1/election/98940102198755335-core_node3-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/98940102198755335-127.0.0.1:34157_solr-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9A9D8E2EDD50D0F5-001
[junit4] 2> Nov 03, 2017 10:51:42 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=10041, maxDocsPerChunk=787, blockSize=718), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=10041, blockSize=718)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3be05b29), locale=ar-SY, timezone=America/Matamoros
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=3,threads=1,free=111598760,total=481296384
[junit4] 2> NOTE: All tests run in this JVM: [CdcrUpdateLogTest, TestExtendedDismaxParser, OutOfBoxZkACLAndCredentialsProvidersTest, TestNoOpRegenerator, TestHalfAndHalfDocValues, TestBlendedInfixSuggestions, TestLegacyFieldReuse, SolrCoreMetricManagerTest, TestEmbeddedSolrServerConstructors, TestComponentsName, RequestLoggingTest, TestConfig, TestDocSet, DistributedFacetPivotWhiteBoxTest, TestStressLiveNodes, TestSolrJ, CopyFieldTest, DistributedExpandComponentTest, SuggestComponentTest, TestPostingsSolrHighlighter, TestRTGBase, AutoAddReplicasIntegrationTest]
[junit4] Completed [40/747 (1!)] on J1 in 153.86s, 1 test, 1 failure <<< FAILURES!
[...truncated 49535 lines...]