You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/02/25 17:06:20 UTC
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 463 -
Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/463/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.CreateRoutedAliasTest.testUnParseableFutureFails
Error Message:
Error from server at http://127.0.0.1:37979/solr: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37979/solr: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
at __randomizedtesting.SeedInfo.seed([A65734BC3718D54:D16FCFEF60BEB5C9]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:444)
at org.apache.solr.cloud.CreateRoutedAliasTest.doBefore(CreateRoutedAliasTest.java:96)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12199 lines...]
[junit4] Suite: org.apache.solr.cloud.CreateRoutedAliasTest
[junit4] 2> 201035 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/init-core-data-001
[junit4] 2> 201036 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 201036 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 201037 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001
[junit4] 2> 201037 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 201037 INFO (Thread-473) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 201037 INFO (Thread-473) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 201039 ERROR (Thread-473) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 201137 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:52947
[junit4] 2> 201140 INFO (zkConnectionManagerCallback-287-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 201147 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 201147 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6cbf8bac{/solr,null,AVAILABLE}
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9c6b33c{/solr,null,AVAILABLE}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7bb6f8a6{HTTP/1.1,[http/1.1]}{127.0.0.1:37979}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.Server Started @203069ms
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37979}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3b559a01{HTTP/1.1,[http/1.1]}{127.0.0.1:40272}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.Server Started @203069ms
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40272}
[junit4] 2> 201149 ERROR (jetty-launcher-284-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 201149 ERROR (jetty-launcher-284-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-25T15:31:37.834Z
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-25T15:31:37.834Z
[junit4] 2> 201153 INFO (zkConnectionManagerCallback-291-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201153 INFO (zkConnectionManagerCallback-290-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201154 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 201155 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 201162 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52947/solr
[junit4] 2> 201163 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52947/solr
[junit4] 2> 201169 INFO (zkConnectionManagerCallback-297-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201169 INFO (zkConnectionManagerCallback-299-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201174 INFO (zkConnectionManagerCallback-301-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201174 INFO (zkConnectionManagerCallback-303-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201331 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 201332 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 201333 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37979_solr
[junit4] 2> 201333 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40272_solr
[junit4] 2> 201334 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.Overseer Overseer (id=72260008177762310-127.0.0.1:37979_solr-n_0000000000) starting
[junit4] 2> 201335 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 201336 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 201349 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37979_solr
[junit4] 2> 201351 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 201353 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 201427 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201432 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201432 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201433 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/.
[junit4] 2> 201466 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201471 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201471 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201472 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/.
[junit4] 2> 201493 INFO (zkConnectionManagerCallback-309-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201496 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b81836e70007, likely client has closed socket
[junit4] 2> 201514 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testV1
[junit4] 2> 201517 INFO (zkConnectionManagerCallback-314-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201519 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 201520 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52947/solr ready
[junit4] 2> 201522 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 201527 INFO (qtp1982654081-1689) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-02-25T15:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testV1&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&create-collection.router.field=foo_s&wt=xml&create-collection.replicationFactor=2 and sendToOCPQueue=true
[junit4] 2> 201537 INFO (OverseerThreadFactory-807-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testV1_2018-02-25_15
[junit4] 2> 201650 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testV1_2018-02-25_15",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testV1_2018-02-25_15_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37979/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 201653 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testV1_2018-02-25_15",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testV1_2018-02-25_15_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40272/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 201860 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node3&name=testV1_2018-02-25_15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 201860 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 201860 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node4&name=testV1_2018-02-25_15_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 201861 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 201970 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 201970 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 201970 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 201971 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 202891 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
[junit4] 2> 202892 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
[junit4] 2> 202893 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 1
[junit4] 2> 202893 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 1
[junit4] 2> 202894 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/extraction/lib
[junit4] 2> 202894 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/extraction/lib
[junit4] 2> 202895 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/clustering/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/clustering/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/langid/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/langid/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/velocity/lib
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/velocity/lib
[junit4] 2> 202897 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202900 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 202901 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 202921 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.IndexSchema [testV1_2018-02-25_15_shard1_replica_n1] Schema name=default-config
[junit4] 2> 202938 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.IndexSchema [testV1_2018-02-25_15_shard1_replica_n2] Schema name=default-config
[junit4] 2> 203168 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
[junit4] 2> 203168 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
[junit4] 2> 203219 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testV1_2018-02-25_15_shard1_replica_n1' using configuration from collection testV1_2018-02-25_15, trusted=true
[junit4] 2> 203221 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.core.testV1_2018-02-25_15.shard1.replica_n1' (registry 'solr.core.testV1_2018-02-25_15.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 203221 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 203221 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrCore [[testV1_2018-02-25_15_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/./testV1_2018-02-25_15_shard1_replica_n1/data/]
[junit4] 2> 203222 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testV1_2018-02-25_15_shard1_replica_n2' using configuration from collection testV1_2018-02-25_15, trusted=true
[junit4] 2> 203223 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.core.testV1_2018-02-25_15.shard1.replica_n2' (registry 'solr.core.testV1_2018-02-25_15.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 203224 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 203224 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrCore [[testV1_2018-02-25_15_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/./testV1_2018-02-25_15_shard1_replica_n2/data/]
[junit4] 2> 203251 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
[junit4] 2> 203251 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
[junit4] 2> 203514 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 203514 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 203515 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 203515 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 203517 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6662abbe[testV1_2018-02-25_15_shard1_replica_n1] main]
[junit4] 2> 203520 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/_default
[junit4] 2> 203520 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/_default
[junit4] 2> 203520 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/_default/managed-schema
[junit4] 2> 203545 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
[junit4] 2> 203549 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 203577 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
[junit4] 2> 203588 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 203588 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593387463761461248
[junit4] 2> 203591 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@6662abbe[testV1_2018-02-25_15_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203592 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
[junit4] 2> 203592 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 203602 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 203602 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 203604 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n1] Registered new searcher Searcher@6662abbe[testV1_2018-02-25_15_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203643 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 203643 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 203644 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@368739ff[testV1_2018-02-25_15_shard1_replica_n2] main]
[junit4] 2> 203646 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/_default
[junit4] 2> 203646 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/_default
[junit4] 2> 203647 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/_default/managed-schema
[junit4] 2> 203647 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
[junit4] 2> 203648 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 203648 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
[junit4] 2> 203649 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 203650 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593387463826472960
[junit4] 2> 203653 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@368739ff[testV1_2018-02-25_15_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203657 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.QuerySenderListener QuerySenderListener done.
[junit4] 2> 203657 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 203690 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n2] Registered new searcher Searcher@368739ff[testV1_2018-02-25_15_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203657 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.ZkShardTerms Failed to save terms, version is not match, retrying
[junit4] 2> 203691 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 203793 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 203793 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 203793 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 203793 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37979/solr/testV1_2018-02-25_15_shard1_replica_n1/
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testV1_2018-02-25_15_shard1_replica_n1 url=http://127.0.0.1:37979/solr START replicas=[http://127.0.0.1:40272/solr/testV1_2018-02-25_15_shard1_replica_n2/] nUpdates=100
[junit4] 2> 204197 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.S.Request [testV1_2018-02-25_15_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testV1_2018-02-25_15_shard1_replica_n1 url=http://127.0.0.1:37979/solr DONE. We have no versions. sync failed.
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 204500 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37979/solr/testV1_2018-02-25_15_shard1_replica_n1/ shard1
[junit4] 2> 204602 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204602 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204602 INFO (zkCallback-302-thread-3-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204603 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204604 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 204607 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node3&name=testV1_2018-02-25_15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=2747
[junit4] 2> 204701 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node4&name=testV1_2018-02-25_15_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=2841
[junit4] 2> 204702 INFO (OverseerThreadFactory-807-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 204806 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204806 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204806 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204806 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 205808 INFO (qtp1982654081-1689) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.interval=%2B30MINUTE&router.start=2018-02-25T15:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testV1&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&create-collection.router.field=foo_s&wt=xml&create-collection.replicationFactor=2} status=0 QTime=4282
[junit4] 2> 205815 INFO (zkConnectionManagerCallback-318-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 205817 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 205819 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52947/solr ready
[junit4] 2> 205822 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testV1
[junit4] 2> 205840 INFO (TEST-CreateRoutedAliasTest.testUnParseableFutureFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testUnParseableFutureFails
[junit4] 2> 205848 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 205852 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 205855 INFO (TEST-CreateRoutedAliasTest.testUnParseableFutureFails-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 205857 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 205860 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 205860 ERROR (OverseerThreadFactory-807-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: testV1_2018-02-25_15 operation: delete failed:org.apache.solr.common.SolrException: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
[junit4] 2> at org.apache.solr.cloud.api.collections.DeleteCollectionCmd.call(DeleteCollectionCmd.java:71)
[junit4] 2> at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:254)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:469)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 205863 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2} status=500 QTime=5
[junit4] 2> 205863 ERROR (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
[junit4] 2> at org.apache.solr.client.solrj.SolrResponse.getException(SolrResponse.java:53)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:260)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:232)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 205864 INFO (TEST-CreateRoutedAliasTest.testUnParseableFutureFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testUnParseableFutureFails
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CreateRoutedAliasTest -Dtests.method=testUnParseableFutureFails -Dtests.seed=A65734BC3718D54 -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Sitka -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.05s J1 | CreateRoutedAliasTest.testUnParseableFutureFails <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37979/solr: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
[junit4] > at __randomizedtesting.SeedInfo.seed([A65734BC3718D54:D16FCFEF60BEB5C9]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
[junit4] > at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:444)
[junit4] > at org.apache.solr.cloud.CreateRoutedAliasTest.doBefore(CreateRoutedAliasTest.java:96)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 205889 INFO (TEST-CreateRoutedAliasTest.testTimeStampWithMsFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTimeStampWithMsFails
[junit4] 2> 205892 INFO (TEST-CreateRoutedAliasTest.testTimeStampWithMsFails-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 205894 INFO (qtp1982654081-1690) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 205897 INFO (OverseerThreadFactory-807-thread-3-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Executing Collection Cmd=action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true, asyncId=null
[junit4] 2> 205897 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 205898 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n1, tag=null
[junit4] 2> 205898 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@52a7caf1: rootName = solr_37979, domain = solr.core.testV1_2018-02-25_15.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testV1_2018-02-25_15.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@27b781c
[junit4] 2> 205898 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n2, tag=null
[junit4] 2> 205898 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77141f19: rootName = solr_40272, domain = solr.core.testV1_2018-02-25_15.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testV1_2018-02-25_15.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@b35086f
[junit4] 2> 205916 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@215b3210
[junit4] 2> 205916 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n1, tag=559624720
[junit4] 2> 205916 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testV1_2018-02-25_15.shard1.leader, tag=559624720
[junit4] 2> 205917 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@2e60596e
[junit4] 2> 205917 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n2, tag=778066286
[junit4] 2> 205917 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testV1_2018-02-25_15.shard1.leader, tag=778066286
[junit4] 2> 205923 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=testV1_2018-02-25_15_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=25
[junit4] 2> 205923 WARN (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not found:testV1_2018-02-25_15_shard1_replica_n2 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:311)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 205923 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.c.ZkShardTerms Failed to save terms, version is not match, retrying
[junit4] 2> 205926 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 205927 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=testV1_2018-02-25_15_shard1_replica_n2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=29
[junit4] 2> 206646 INFO (qtp1982654081-1690) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2} status=0 QTime=751
[junit4] 2> 206647 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00.001Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testTimeStampWithMsFails&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json and sendToOCPQueue=true
[junit4] 2> 206650 ERROR (OverseerThreadFactory-807-thread-4-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: testTimeStampWithMsFails operation: createroutedalias failed:org.apache.solr.common.SolrException: Date or date math for start time includes milliseconds, which is not supported. (Hint: 'NOW' used without rounding always has this problem)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.checkMilis(CreateAliasCmd.java:141)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.parseStart(CreateAliasCmd.java:135)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.callCreateRoutedAlias(CreateAliasCmd.java:119)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.call(CreateAliasCmd.java:65)
[junit4] 2> at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:254)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:469)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 206651 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 206654 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00.001Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testTimeStampWithMsFails&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json} status=400 QTime=6
[junit4] 2> 206655 INFO (TEST-CreateRoutedAliasTest.testTimeStampWithMsFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTimeStampWithMsFails
[junit4] 2> 206673 INFO (TEST-CreateRoutedAliasTest.testTimezoneAbsoluteDate-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTimezoneAbsoluteDate
[junit4] 2> 206676 INFO (TEST-CreateRoutedAliasTest.testTimezoneAbsoluteDate-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 206680 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 206681 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 206685 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 206686 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 206686 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 206686 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 206691 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&TZ=GMT-10:00&router.name=time&create-collection.numShards=1&create-collection.nrtReplicas=1&version=2&router.interval=%2B30MINUTE&router.field=evt_dt&name=testTimezoneAbsoluteDate&action=CREATEROUTEDALIAS&wt=javabin&create-collection.replicationFactor=1 and sendToOCPQueue=true
[junit4] 2> 206694 INFO (OverseerThreadFactory-807-thread-5-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testTimezoneAbsoluteDate_2018-01-15
[junit4] 2> 206694 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 206911 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testTimezoneAbsoluteDate_2018-01-15",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40272/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 207114 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testTimezoneAbsoluteDate_2018-01-15&version=2&replicaType=NRT&property.routedAliasName=testTimezoneAbsoluteDate&coreNodeName=core_node2&name=testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 207220 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 207220 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 208136 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
[junit4] 2> 208137 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 1
[junit4] 2> 208137 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/extraction/lib
[junit4] 2> 208137 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/clustering/lib
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/langid/lib
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/velocity/lib
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208160 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 208176 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.s.IndexSchema [testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] Schema name=default-config
[junit4] 2> 208365 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
[junit4] 2> 208431 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1' using configurat
[...truncated too long message...]
NFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 215776 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 215777 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c1e7c5a: rootName = solr_40272, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2edb3319
[junit4] 2> 215777 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3379c62b: rootName = solr_37979, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@277005ca
[junit4] 2> 215782 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 215782 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@29252dc7: rootName = solr_40272, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@65c14d0d
[junit4] 2> 215785 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 215786 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4247fc7a: rootName = solr_40272, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@61fed56d
[junit4] 2> 215787 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 215787 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6e459578: rootName = solr_37979, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@65c14d0d
[junit4] 2> 215788 INFO (jetty-closer-285-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40272_solr
[junit4] 2> 215788 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 215789 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 215792 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 215798 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 215799 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b81836e70005, likely client has closed socket
[junit4] 2> 215799 INFO (jetty-closer-285-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9c6b33c{/solr,null,UNAVAILABLE}
[junit4] 2> 215799 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@73a8507e: rootName = solr_37979, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@61fed56d
[junit4] 2> 215800 INFO (jetty-closer-285-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 215808 INFO (jetty-closer-285-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37979_solr
[junit4] 2> 215810 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 215810 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 215813 INFO (jetty-closer-285-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72260008177762310-127.0.0.1:37979_solr-n_0000000000) closing
[junit4] 2> 215814 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37979_solr
[junit4] 2> 215815 WARN (OverseerAutoScalingTriggerThread-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 215822 INFO (jetty-closer-285-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6cbf8bac{/solr,null,UNAVAILABLE}
[junit4] 2> 215825 INFO (jetty-closer-285-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 215827 ERROR (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 215828 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52947 52947
[junit4] 2> 215894 INFO (Thread-473) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52947 52947
[junit4] 2> 215894 WARN (Thread-473) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 15 /solr/clusterprops.json
[junit4] 2> 15 /solr/aliases.json
[junit4] 2> 7 /solr/configs/_default/managed-schema
[junit4] 2> 6 /solr/collections/testV1_2018-02-25_15/terms/shard1
[junit4] 2> 4 /solr/configs/_default
[junit4] 2> 4 /solr/collections/testV2_2018-02-25/terms/foo
[junit4] 2> 4 /solr/collections/testV2_2018-02-25/terms/bar
[junit4] 2> 3 /solr/collections/testTimezoneAbsoluteDate_2018-01-15/terms/shard1
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 22 /solr/aliases.json
[junit4] 2> 15 /solr/clusterstate.json
[junit4] 2> 12 /solr/collections/testV1_2018-02-25_15/state.json
[junit4] 2> 11 /solr/collections/testV2_2018-02-25/state.json
[junit4] 2> 5 /solr/collections/testTimezoneAbsoluteDate_2018-01-15/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 41 /solr/collections
[junit4] 2> 15 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001
[junit4] 2> Feb 25, 2018 3:31:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=477, maxMBSortInHeap=6.448851584935259, sim=RandomSimilarity(queryNorm=false): {}, locale=sq, timezone=America/Sitka
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=102944544,total=282836992
[junit4] 2> NOTE: All tests run in this JVM: [DistributedIntervalFacetingTest, HdfsBasicDistributedZk2Test, BasicFunctionalityTest, HdfsTlogReplayBufferedWhileIndexingTest, MergeStrategyTest, CollectionsAPIAsyncDistributedZkTest, TestApiFramework, ExternalFileFieldSortTest, TestCrossCoreJoin, TestCoreBackup, TestDirectoryFactory, UUIDFieldTest, TlogReplayBufferedWhileIndexingTest, HighlighterConfigTest, TestDFRSimilarityFactory, TestBlendedInfixSuggestions, TestDistributedGrouping, BigEndianAscendingWordSerializerTest, TestRandomRequestDistribution, DistributedQueueTest, TestAtomicUpdateErrorCases, TestExecutePlanAction, OverseerStatusTest, TestJsonFacets, SortSpecParsingTest, IndexBasedSpellCheckerTest, TestFieldTypeCollectionResource, TestPushWriter, ReturnFieldsTest, CollectionStateFormat2Test, CSVRequestHandlerTest, TestConfigsApi, CreateRoutedAliasTest]
[junit4] Completed [46/777 (1!)] on J1 in 15.38s, 9 tests, 1 error <<< FAILURES!
[...truncated 50955 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/463/consoleText
[repro] Revision: 72f23c89ec0a845d25129be2462c79147f6ff0e5
[repro] Repro line: ant test -Dtestcase=CreateRoutedAliasTest -Dtests.method=testUnParseableFutureFails -Dtests.seed=A65734BC3718D54 -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Sitka -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC"
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] CreateRoutedAliasTest
[repro] ant compile-test
[...truncated 3331 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.CreateRoutedAliasTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC" -Dtests.seed=A65734BC3718D54 -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Sitka -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 108 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.CreateRoutedAliasTest
[repro] Exiting with code 0
[...truncated 70 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 466 -
Still unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/466/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063) 2) Thread[id=33400, name=jetty-launcher-7743-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
2) Thread[id=33400, name=jetty-launcher-7743-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)
Build Log:
[...truncated 14005 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> 3276387 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/init-core-data-001
[junit4] 2> 3276388 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 3276389 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 3276421 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001
[junit4] 2> 3276421 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3276422 INFO (Thread-9127) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3276422 INFO (Thread-9127) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3276434 ERROR (Thread-9127) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3276521 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:53461
[junit4] 2> 3276524 INFO (zkConnectionManagerCallback-7746-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276529 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T11:12:37+13:45, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T11:12:37+13:45, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4009d9c9{/solr,null,AVAILABLE}
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28adb0b1{/solr,null,AVAILABLE}
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@35f10d0c{HTTP/1.1,[http/1.1]}{127.0.0.1:37475}
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.Server Started @3280816ms
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@32022f59{HTTP/1.1,[http/1.1]}{127.0.0.1:47813}
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37475}
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.Server Started @3280816ms
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47813}
[junit4] 2> 3276533 ERROR (jetty-launcher-7743-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3276533 ERROR (jetty-launcher-7743-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-28T18:35:00.400Z
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-28T18:35:00.400Z
[junit4] 2> 3276535 INFO (zkConnectionManagerCallback-7750-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276535 INFO (zkConnectionManagerCallback-7748-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276536 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3276536 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3276543 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53461/solr
[junit4] 2> 3276543 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53461/solr
[junit4] 2> 3276545 INFO (zkConnectionManagerCallback-7756-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276545 INFO (zkConnectionManagerCallback-7758-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276548 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276548 INFO (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276708 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3276710 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47813_solr
[junit4] 2> 3276711 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.Overseer Overseer (id=72277727914229766-127.0.0.1:47813_solr-n_0000000000) starting
[junit4] 2> 3276718 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3276720 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37475_solr
[junit4] 2> 3276722 INFO (zkCallback-7761-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3276722 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3276727 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47813_solr
[junit4] 2> 3276728 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3276728 INFO (zkCallback-7761-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3276752 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 3276752 WARN (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276752 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 3276754 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 3276754 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 3276754 WARN (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276755 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 3276756 INFO (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 3276756 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 3276758 INFO (jetty-launcher-7743-thread-1-EventThread) [n:127.0.0.1:47813_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 3276775 WARN (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276785 WARN (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276846 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47813.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276850 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276852 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47813.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276852 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47813.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276853 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node1/.
[junit4] 2> 3276856 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276856 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276857 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node2/.
[junit4] 2> 3276893 INFO (zkConnectionManagerCallback-7768-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276895 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c835e9800009, likely client has closed socket
[junit4] 2> 3276914 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 3276918 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 3276946 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 3276948 INFO (zkConnectionManagerCallback-7771-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3277638 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3277639 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3277640 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53461/solr ready
[junit4] 2> 3277664 INFO (qtp594512031-33278) [n:127.0.0.1:37475_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3277670 INFO (OverseerThreadFactory-12431-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 3277781 INFO (OverseerStateUpdate-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37475/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3277987 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3277987 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3278093 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3278093 INFO (zkCallback-7759-thread-2-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279008 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3279038 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 3279116 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node2/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node2/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 3279136 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1721715196, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 3279197 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3279197 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3279198 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3279198 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3279199 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=88.322265625, floorSegmentMB=1.353515625, forceMergeDeletesPctAllowed=7.033433996018158, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3221262889029142
[junit4] 2> 3279199 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7fbaa041[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 3279200 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 3279205 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 3279221 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3279222 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593670791949451264
[junit4] 2> 3279222 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 3279223 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 3279223 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 3279223 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 3279224 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 3279225 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 3279225 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 3279225 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 3279226 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 3279227 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@7fbaa041[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 3279237 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 3279340 INFO (zkCallback-7759-thread-2-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279340 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279388 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3279391 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1404
[junit4] 2> 3279395 INFO (qtp594512031-33278) [n:127.0.0.1:37475_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 3279492 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279493 INFO (zkCallback-7759-thread-2-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279673 INFO (OverseerCollectionConfigSetProcessor-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3280399 INFO (qtp594512031-33278) [n:127.0.0.1:37475_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2736
[junit4] 2> 3280400 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 3280401 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 3280403 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3280406 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 3280409 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 3280409 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 3280434 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 3280438 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 3280462 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 3280478 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3280479 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3280479 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 3280499 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 3299760 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 20272ms for sessionid 0x100c835e9800005
[junit4] 2> 3299761 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c835e9800005, likely client has closed socket
[junit4] 2> 3299762 WARN (jetty-launcher-7743-thread-1-SendThread(127.0.0.1:53461)) [n:127.0.0.1:47813_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 19288ms for sessionid 0x100c835e9800006
[junit4] 2> 3299763 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c835e9800006, likely client has closed socket
[junit4] 2> 3299764 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 3299808 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 3299843 WARN (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 3299845 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 3299863 INFO (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 3299867 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e7e5f21 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 3299867 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 3299869 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1dbc8407 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 3299869 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 3299869 WARN (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ab885c3 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 3299873 WARN (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 3299905 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 3299906 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3300969 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]-SendThread(127.0.0.1:53461)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e980000b has expired
[junit4] 2> 3300969 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1dbc8407 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 3300969 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 3300970 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 3300971 INFO (zkConnectionManagerCallback-7774-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3300971 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 3300973 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 3300975 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 3300975 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient Connected:true
[junit4] 2> 3301073 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e9800007 has expired
[junit4] 2> 3301373 INFO (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3301374 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=1468
[junit4] 2> 3301374 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 3301374 INFO (zkCallback-7761-thread-7-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 3301405 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 3301405 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:458)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:353)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 3301407 WARN (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.e.j.s.HttpChannel /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:464)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:353)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:458)
[junit4] 2> ... 31 more
[junit4] 2> 3301413 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 3301442 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 3301444 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3301444 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3301445 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 3301476 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 3301481 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 3301514 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 3301516 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 3301548 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 3301570 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 3301575 INFO (jetty-closer-7744-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@32022f59{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 3301576 INFO (jetty-closer-7744-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@35f10d0c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 3301577 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=358670363
[junit4] 2> 3301577 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1850659926
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6f07ebdf: rootName = solr_47813, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@577267d6
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3f76a0e6: rootName = solr_37475, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1bb96d12
[junit4] 2> 3301594 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 3301594 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5fb46a47: rootName = solr_47813, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@18f9b081
[junit4] 2> 3301597 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 3301597 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@675ffd3e: rootName = solr_37475, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@18f9b081
[junit4] 2> 3301600 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 3301600 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2b81f176: rootName = solr_47813, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7133a8de
[junit4] 2> 3301602 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:47813_solr
[junit4] 2> 3301602 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 3301602 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5adb7471: rootName = solr_37475, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7133a8de
[junit4] 2> 3301603 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 3301604 INFO (zkCallback-7761-thread-7-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 3301604 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72277727914229766-127.0.0.1:47813_solr-n_0000000000) closing
[junit4] 2> 3301605 INFO (OverseerStateUpdate-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:47813_solr
[junit4] 2> 3301605 WARN (OverseerAutoScalingTriggerThread-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 3301611 ERROR (Thread[Thread-9144,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:47813_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 3301622 WARN (jetty-launcher-7743-thread-1-SendThread(127.0.0.1:53461)) [n:127.0.0.1:47813_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e9800008 has expired
[junit4] 2> 3301725 INFO (jetty-closer-7744-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4009d9c9{/solr,null,UNAVAILABLE}
[junit4] 2> 3301725 INFO (jetty-closer-7744-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 3301743 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e9800005 has expired
[junit4] 2> 3301743 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e7e5f21 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 3301743 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 3301743 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 3301744 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr-EventThread) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3301745 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 3301745 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration.
[junit4] 2> 3301747 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 3301753 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37475_solr
[junit4] 2> 3301756 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37475_solr
[junit4] 2> 3301757 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController Registering core forwardingCollection_shard1_replica_n1 afterExpiration? true
[junit4] 2> 3301757 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 3301757 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient Connected:true
[junit4] 2> 3301758 INFO (zkCallback-7759-thread-6-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3301758 INFO (Thread-9152) [n:127.0.0.1:37475_solr ] o.a.s.c.SolrCore config update listener called for core forwardingCollection_shard1_replica_n1
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 3301762 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 3301762 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3301844 ERROR (jetty-closer-7744-thread-2) [ ] o.a.s.c.Overseer Could not create Overseer node
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:796)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:662)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:649)
[junit4] 2> at org.apache.solr.cloud.ZkController.publishNodeAsDown(ZkController.java:2727)
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:747)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.destroy(SolrDispatchFilter.java:321)
[junit4] 2> at org.eclipse.jetty.servlet.FilterHolder.destroyInstance(FilterHolder.java:178)
[junit4] 2> at org.eclipse.jetty.servlet.FilterHolder.doStop(FilterHolder.java:155)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doStop(ServletHandler.java:234)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doStop(SessionHandler.java:519)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.stopContext(ContextHandler.java:863)
[junit4] 2> at org.eclipse.jetty.servlet.ServletContextHandler.stopContext(ServletContextHandler.java:355)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:927)
[junit4] 2> at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:271)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.server.Server.doStop(Server.java:489)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner.stop(JettySolrRunner.java:430)
[junit4] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.stopJettySolrRunner(MiniSolrCloudCluster.java:423)
[junit4] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$shutdown$1(MiniSolrCloudCluster.java:460)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 3301844 WARN (jetty-closer-7744-thread-2) [ ] o.a.s.c.ZkController Could not publish node as down: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
[junit4] 2> 3301844 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37475_solr
[junit4] 2> 3301846 INFO (zkCallback-7759-thread-6-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 3301846 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 3301847 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@6786b16c
[junit4] 2> 3301847 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=1736880492
[junit4] 2> 3301847 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14692c06: rootName = solr_37475, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@7c69265a
[junit4] 2> 3301856 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=1736880492
[junit4] 2> 3301863 ERROR (Thread[Thread-9146,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:37475_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 3301868 INFO (jetty-closer-7744-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@28adb0b1{/solr,null,UNAVAILABLE}
[junit4] 2> 3301868 INFO (jetty-closer-7744-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 3301870 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3301871 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53461 53461
[junit4] 2> 3302682 INFO (Thread-9127) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53461 53461
[junit4] 2> 3302683 WARN (Thread-9127) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/collections/forwardingCollection/terms/shard1
[junit4] 2> 2 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/forwardingCollection/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 3302712 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 28, 2018 6:35:26 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 3329948 ERROR (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.IllegalStateException: Client is not started
[junit4] 2> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
[junit4] 2> at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> 3329950 WARN (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.ConnectionState Session expired event received
[junit4] 2> 3329951 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3331054 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3332157 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3332769 ERROR (jetty-launcher-7743-thread-1-EventThread) [n:127.0.0.1:47813_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.IllegalStateException: Client is not started
[junit4] 2> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
[junit4] 2> at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> 3333265 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3334369 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3335475 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3336585 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3337687 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3338788 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3339890 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[...truncated too long message...]
y-launcher-1-thread-2-SendThread(127.0.0.1:39582)) [n:127.0.0.1:34265_solr ] o.a.z.c.StaticHostProvider Unexpected exception
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> 124999 WARN (jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582)) [n:127.0.0.1:42449_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 124999 WARN (jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582)) [n:127.0.0.1:34265_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> Feb 28, 2018 6:58:42 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=161, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> 2) Thread[id=159, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1477, maxMBSortInHeap=6.977892473957818, sim=RandomSimilarity(queryNorm=false): {}, locale=be-BY, timezone=Pacific/Chatham
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=3,free=35223536,total=97583104
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=DB2EA697A77E4AE7 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=be-BY -Dtests.timezone=Pacific/Chatham -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=161, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > 2) Thread[id=162, name=jetty-launcher-1-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] > 3) Thread[id=159, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1249)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1173)
[junit4] > 4) Thread[id=160, name=jetty-launcher-1-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] > at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=161, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > 2) Thread[id=159, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)
[junit4] Completed [2/5 (2!)] on J1 in 126.34s, 12 tests, 2 errors <<< FAILURES!
[...truncated 21 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1561: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1085: There were test failures: 5 suites, 60 tests, 4 suite-level errors, 36 ignored [seed: DB2EA697A77E4AE7]
Total time: 2 minutes 9 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 2/5 failed: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=f48fc470f665d2eda1b959ec3472cd5f711afaa0, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #464
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 465 -
Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/465/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
No tests ran.
Build Log:
[...truncated 62658 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/465/consoleText
[repro] Revision: 9b7e35e69b694d9006c0964ae7a26ed2694ea055
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] No "reproduce with" lines found; exiting.
[...truncated 8 lines...]
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 464 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/464/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=2198, name=jetty-launcher-468-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=2196, name=jetty-launcher-468-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=2198, name=jetty-launcher-468-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=2196, name=jetty-launcher-468-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
at __randomizedtesting.SeedInfo.seed([F89F48920C7E63FE]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 1) Thread[id=50195, name=jetty-launcher-11970-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=50186, name=jetty-launcher-11970-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
1) Thread[id=50195, name=jetty-launcher-11970-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=50186, name=jetty-launcher-11970-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
at __randomizedtesting.SeedInfo.seed([F89F48920C7E63FE]:0)
Build Log:
[...truncated 12336 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> 360278 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/init-core-data-001
[junit4] 2> 360278 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
[junit4] 2> 360279 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 360280 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 360304 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001
[junit4] 2> 360305 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 360305 INFO (Thread-451) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 360305 INFO (Thread-451) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 360307 ERROR (Thread-451) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 360405 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:57294
[junit4] 2> 360408 INFO (zkConnectionManagerCallback-471-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360413 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 360413 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 360414 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 360414 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 360414 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6b5d522e{/solr,null,AVAILABLE}
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@969aa5c{/solr,null,AVAILABLE}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@58fb3eb5{HTTP/1.1,[http/1.1]}{127.0.0.1:50694}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.Server Started @362866ms
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50694}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7714b016{HTTP/1.1,[http/1.1]}{127.0.0.1:50290}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.Server Started @362867ms
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50290}
[junit4] 2> 360419 ERROR (jetty-launcher-468-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-26T01:48:11.280Z
[junit4] 2> 360420 ERROR (jetty-launcher-468-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-26T01:48:11.282Z
[junit4] 2> 360424 INFO (zkConnectionManagerCallback-475-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360424 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 360425 INFO (zkConnectionManagerCallback-473-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360426 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 360433 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57294/solr
[junit4] 2> 360433 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57294/solr
[junit4] 2> 360436 INFO (zkConnectionManagerCallback-481-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360437 INFO (zkConnectionManagerCallback-483-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360439 INFO (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360441 INFO (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360569 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 360569 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 360570 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50694_solr
[junit4] 2> 360571 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50290_solr
[junit4] 2> 360571 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.Overseer Overseer (id=72262434194391046-127.0.0.1:50694_solr-n_0000000000) starting
[junit4] 2> 360581 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 360581 INFO (zkCallback-486-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 360590 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50694_solr
[junit4] 2> 360591 INFO (zkCallback-486-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 360591 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 360622 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 360627 WARN (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360631 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 360671 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 360671 WARN (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360672 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 360694 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 360694 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 360715 INFO (jetty-launcher-468-thread-1-EventThread) [n:127.0.0.1:50290_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 360715 INFO (jetty-launcher-468-thread-2-EventThread) [n:127.0.0.1:50694_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 360823 WARN (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360824 WARN (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360862 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50694.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360867 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50694.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360868 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50694.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360869 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node2/.
[junit4] 2> 360874 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360897 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360897 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360899 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node1/.
[junit4] 2> 360917 INFO (zkConnectionManagerCallback-493-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360938 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-1-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50290_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13354ms for sessionid 0x100ba4d10c30005
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-1-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50290_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13433ms for sessionid 0x100ba4d10c30008
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-2-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50694_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13433ms for sessionid 0x100ba4d10c30007
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-2-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50694_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13384ms for sessionid 0x100ba4d10c30006
[junit4] 2> 374251 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30005, likely client has closed socket
[junit4] 2> 374252 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30008, likely client has closed socket
[junit4] 2> 374252 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30007, likely client has closed socket
[junit4] 2> 374252 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30006, likely client has closed socket
[junit4] 2> 374265 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519645691809&s=EzzbqnAJtiyndyPFSCP+7jzTxaA="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:11 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:11 GMT
[junit4] 2> 374265 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 374284 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 374310 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1519645705146&s=8rAm6KIvsuMjt0QyDcgNGxrgSOY="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:25 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:25 GMT
[junit4] 2> 374310 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 374326 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 374330 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 374330 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 374330 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519645705187&s=arkL0bLKuBdhuoWbb2ZFMmZ0w88="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:25 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:25 GMT
[junit4] 2> 374331 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 374350 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 374353 WARN (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2723808a name: ZooKeeperConnection Watcher:127.0.0.1:57294/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 374353 WARN (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 374354 WARN (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f22a67c name: ZooKeeperConnection Watcher:127.0.0.1:57294/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 374354 WARN (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 374354 INFO (zkConnectionManagerCallback-496-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 374922 INFO (zkConnectionManagerCallback-499-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 374924 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 374925 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57294/solr ready
[junit4] 2> 374928 INFO (qtp1528510916-2145) [n:127.0.0.1:50290_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 375746 INFO (jetty-launcher-468-thread-2-EventThread) [n:127.0.0.1:50694_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 376073 INFO (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 376136 INFO (OverseerThreadFactory-924-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 376137 INFO (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 376247 INFO (OverseerStateUpdate-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50290/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 376334 INFO (jetty-launcher-468-thread-1-EventThread) [n:127.0.0.1:50290_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 376452 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 376453 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 376562 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 376562 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 377484 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 377502 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 377602 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node1/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node1/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.720355493720944]
[junit4] 2> 377695 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 377695 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 377696 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 377696 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 377697 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=27.5771484375, floorSegmentMB=1.6728515625, forceMergeDeletesPctAllowed=24.301358520999234, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 377697 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@552e3ec0[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 377698 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 377703 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 377724 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 377725 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593426269790273536
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 377726 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 377726 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 377727 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 377727 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 377727 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 377728 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@552e3ec0[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50290/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:50290/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 377744 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50290/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 377846 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 377846 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 377903 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 377905 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1453
[junit4] 2> 377906 WARN (httpShardExecutor-920-thread-1-processing-n:127.0.0.1:50694_solr [http:////127.0.0.1:50290//solr] http:////127.0.0.1:50290//solr) [n:127.0.0.1:50694_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519645707312&s=0Atl8eY+ofcYH5FjKKCTYCNgm+U="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:27 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:27 GMT
[junit4] 2> 377910 INFO (qtp1528510916-2145) [n:127.0.0.1:50290_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 378014 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 378014 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 378138 INFO (OverseerCollectionConfigSetProcessor-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 378911 INFO (qtp1528510916-2145) [n:127.0.0.1:50290_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3984
[junit4] 2> 378912 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519645705789&s=JHYno0an5t2jzoHNSVMZOMCBZmc="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:25 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:25 GMT
[junit4] 2> 378912 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 378913 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 378915 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 378919 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 378920 WARN (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519645709780&s=4EK+sezeVM8neb0NrmVeckmyqYo="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378920 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519645709776&s=QCPv7G4tbN1HmU4PGyI36ObbVb8="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378920 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519645709780&s=4EK+sezeVM8neb0NrmVeckmyqYo="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378923 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 378923 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519645709784&s=zOesxSkKojlNqjHs9iVhH9nEfrY="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378924 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 378945 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 378962 WARN (qtp217168763-2155) [ ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 378965 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1519645709807&s=SObjn4j/loHlrE2up2V0E4b+JbI="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378965 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 378993 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 378995 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1519645709854&s=YWDPbzlobvTEbB8JMreHpCmlCng="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378995 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 379023 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 379029 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519645709885&s=060twuZNtZKQzSCamdhQwkrKPUs="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 379029 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 379061 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 379063 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1519645709923&s=TmOc3dTBsj7AM2Pekl3vndzYIMg="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 379063 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 379090 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 379090 INFO (qtp217168763-2155) [ ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 379091 WARN (qtp217168763-2155) [ ] o.e.j.s.HttpChannel /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:460)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
[junit4] 2> ... 31 more
[junit4] 2> 379096 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 379132 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 379134 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1519645709994&s=KGFkCs6of7y67ScjkQdl9bleO10="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 379134 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 379156 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 379157 INFO (qtp217168763-2155) [n:127.0.0.1:50694_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 379157 INFO (qtp217168763-2155) [n:127.0.0.1:50694_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 379158 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1519645710018&s=GgfYjUfeCq3B2GQJVZpHaJPth4U="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:30 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:30 GMT
[junit4] 2> 379158 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 379177 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 379178 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 379179 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 379179 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1519645710038&s=VYkxFeBX2yHUAXbikt+j7O60ZBo="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:30 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:30 GMT
[junit4] 2> 379179 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 379180 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c3000b, likely client has closed socket
[junit4] 2> 379181 INFO (jetty-closer-469-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7714b016{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 379182 INFO (jetty-closer-469-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@58fb3eb5{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 379182 INFO (jetty-closer-469-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1150806005
[junit4] 2> 379182 INFO (jetty-closer-469-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=350578277
[junit4] 2> 379182 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 379182 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 379183 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@593567fe: rootName = solr_50694, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4bf25941
[junit4] 2> 379183 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@655e5455: rootName = solr_50290, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3d4527c3
[junit4] 2> 379187 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 379187 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 379187 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a57b8fc: rootName = solr_50290, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a81ed3e
[junit4] 2> 379187 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@378a78f: rootName = solr_50694, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a81ed3e
[junit4] 2> 379190 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 379190 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5e3cf17e: rootName = solr_50694, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@718ab80
[junit4] 2> 379190 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 379190 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@773ff30: rootName = solr_50290, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@718ab80
[junit4] 2> 379192 INFO (jetty-closer-469-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:50290_solr
[junit4] 2> 379192 INFO (jetty-closer-469-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:50694_solr
[junit4] 2> 379193 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 379194 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 379194 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@68bfd465
[junit4] 2> 379194 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=1757402213
[junit4] 2> 379194 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b131532: rootName = solr_50290, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@75f4e43c
[junit4] 2> 379195 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 379195 INFO (zkCallback-486-thread-3-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 379197 INFO (jetty-closer-469-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72262434194391046-127.0.0.1:50694_solr-n_0000000000) closing
[junit4] 2> 379199 INFO (OverseerStateUpdate-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:50694_solr
[junit4] 2> 379199 WARN (OverseerAutoScalingTriggerThread-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 379203 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30006, likely client has closed socket
[junit4] 2> 379207 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50290_solr
[junit4] 2> 379211 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=1757402213
[junit4] 2> 379219 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30005, likely client has closed socket
[junit4] 2> 379221 ERROR (Thread[Thread-468,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:50290_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 379233 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30008, likely client has closed socket
[junit4] 2> 379234 INFO (jetty-closer-469-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6b5d522e{/solr,null,UNAVAILABLE}
[junit4] 2> 379234 INFO (jetty-closer-469-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 380702 WARN (zkCallback-486-thread-3-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:50694_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:50694_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 380703 ERROR (Thread[Thread-470,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:50694_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 380705 INFO (jetty-closer-469-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@969aa5c{/solr,null,UNAVAILABLE}
[junit4] 2> 380706 INFO (jetty-closer-469-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 380707 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 380708 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57294 57294
[junit4] 2> 384460 INFO (Thread-451) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57294 57294
[junit4] 2> 384462 WARN (Thread-451) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/collections/forwardingCollection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 5 /solr/collections/forwardingCollection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 384486 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 26, 2018 1:48:35 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> Feb 26, 2018 1:48:55 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] 2> 1) Thread[id=2198, name=jetty-launcher-468-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2>
[...truncated too long message...]
t, IndexSchemaTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, TestComponentsName, SearchHandlerTest, HighlighterConfigTest, SOLR749Test, UpdateParamsTest, TestQuerySenderNoQuery, CopyFieldTest, BadComponentTest, TestStressRecovery, TestMergePolicyConfig, TestElisionMultitermQuery, TestConfig, TestLuceneMatchVersion, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, RAMDirectoryFactoryTest, TestSolrJ, TestDocumentBuilder, UUIDFieldTest, CursorPagingTest, TestDistributedMissingSort, TestTolerantSearch, TestLuceneIndexBackCompat, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, ConnectionReuseTest, AddReplicaTest, CollectionsAPISolrJTest, DeleteReplicaTest, DistributedQueueTest, HttpPartitionOnCommitTest, MoveReplicaHDFSTest, MultiThreadedOCPTest, RecoveryAfterSoftCommitTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCloudSearcherWarming, TestExclusionRuleCollectionAccess, TestLockTree, TestOnReconnectListenerSupport, TestRandomFlRTGCloud, TestRandomRequestDistribution, TestRequestForwarding, TestSSLRandomization, TestSegmentSorting, TestSizeLimitedDistributedMap, TestSolrCloudWithDelegationTokens, TestTolerantUpdateProcessorRandomCloud, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, HdfsCollectionsAPIDistributedZkTest, ShardSplitTest, HttpTriggerListenerTest, MetricTriggerTest, NodeAddedTriggerTest, TriggerIntegrationTest, TestImplicitCoreProperties, TestInfoStreamLogging, TestNRTOpen, TestShardHandlerFactory, TestSimpleTextCodec, TestSolrConfigHandler, TestCoreBackup, TestSQLHandlerNonCloud, TestSolrConfigHandlerCloud, InfoHandlerTest, MetricsHandlerTest, PropertiesRequestHandlerTest, SecurityConfHandlerTest, SegmentsInfoRequestHandlerTest, StatsReloadRaceTest, TestApiFramework, TestCoreAdminApis, CustomHighlightComponentTest, DistributedFacetPivotLongTailTest, FacetPivotSmallTest, InfixSuggestersTest, ReplicaListTransformerTest, ShufflingReplicaListTransformerTest, SuggestComponentContextFilterQueryTest, TestExpandComponent, TestTrackingShardHandlerFactory, TestLegacyNumericUtils, TestLegacyTerms, TestNumericTokenStream, JvmMetricsTest, MetricsConfigTest, SolrCoreMetricManagerTest, SolrMetricManagerTest, SolrMetricReporterTest, SolrMetricsIntegrationTest, SolrGraphiteReporterTest, SolrJmxReporterCloudTest, SolrSlf4jReporterTest, SolrCloudReportersTest, SolrShardReporterTest, TestManagedResource, TestBulkSchemaAPI, TestSchemaVersionResource, TestUniqueKeyFieldResource, TestManagedSynonymFilterFactory, TestManagedSynonymGraphFilterFactory, EnumFieldTest, ManagedSchemaRoundRobinCloudTest, SpatialRPTFieldTypeTest, TestBulkSchemaConcurrent, TestHalfAndHalfDocValues, TestManagedSchema, TestManagedSchemaAPI, TestManagedSchemaThreadSafety, TestSchemalessBufferedUpdates, TestSortableTextField, TestUseDocValuesAsStored2, AnalyticsMergeStrategyTest, RankQueryTest, TestCollapseQParserPlugin, TestComplexPhraseQParserPlugin, TestInitQParser, TestLegacyNumericRangeQueryBuilder, TestMissingGroups, TestOverriddenPrefixQueryForCustomFieldType, TestQueryWrapperFilter, TestRecoveryHdfs, TestMinMaxOnMultiValuedField, TestSortByMinMaxFunction, GraphQueryTest, TestJsonRequest, SimpleMLTQParserTest, TestClassicSimilarityFactory, TestDFISimilarityFactory, TestNonDefinedSimilarityFactory, TestDistribIDF, PKIAuthenticationIntegrationTest, TestImpersonationWithHadoopAuth]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=America/Nome -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | TestImpersonationWithHadoopAuth (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
[junit4] > 1) Thread[id=50195, name=jetty-launcher-11970-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > 2) Thread[id=50186, name=jetty-launcher-11970-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > at __randomizedtesting.SeedInfo.seed([F89F48920C7E63FE]:0)
[junit4] Completed [752/777 (2!)] on J0 in 42.92s, 10 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 48605 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/464/consoleText
[repro] Revision: 72f23c89ec0a845d25129be2462c79147f6ff0e5
[repro] Repro line: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Europe/Prague -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=America/Nome -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestSolrCloudWithSecureImpersonation
[repro] TestImpersonationWithHadoopAuth
[repro] ant compile-test
[...truncated 3331 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestSolrCloudWithSecureImpersonation|*.TestImpersonationWithHadoopAuth" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Europe/Prague -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 194 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[repro] 0/5 failed: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
[repro] Exiting with code 0
[...truncated 70 lines...]