You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2019/04/04 14:36:07 UTC
[JENKINS] Lucene-Solr-8.x-Linux (64bit/jdk-12) - Build # 346 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/346/
Java: 64bit/jdk-12 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenRenew
Error Message:
expected:<200> but was:<403>
Stack Trace:
java.lang.AssertionError: expected:<200> but was:<403>
at __randomizedtesting.SeedInfo.seed([BFBD5DE26F9183BE:8826A9FC575D5E1A]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:645)
at org.junit.Assert.assertEquals(Assert.java:631)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.renewDelegationToken(TestDelegationWithHadoopAuth.java:120)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.verifyDelegationTokenRenew(TestDelegationWithHadoopAuth.java:303)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenRenew(TestDelegationWithHadoopAuth.java:321)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:835)
Build Log:
[...truncated 15385 lines...]
[junit4] Suite: org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_BFBD5DE26F9183BE-001/init-core-data-001
[junit4] 2> 2908926 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2908927 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 2908928 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2908928 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_BFBD5DE26F9183BE-001/tempDir-001
[junit4] 2> 2908928 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2908937 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2908937 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2909035 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41833
[junit4] 2> 2909035 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:41833
[junit4] 2> 2909035 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 41833
[junit4] 2> 2909080 INFO (zkConnectionManagerCallback-16574-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909119 INFO (zkConnectionManagerCallback-16576-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909157 INFO (zkConnectionManagerCallback-16578-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909163 WARN (jetty-launcher-16579-thread-1) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 2909163 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 2909163 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 2909163 INFO (jetty-launcher-16579-thread-1) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 12+33
[junit4] 2> 2909185 WARN (jetty-launcher-16579-thread-2) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 2909185 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 2909185 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 2909185 INFO (jetty-launcher-16579-thread-2) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 12+33
[junit4] 2> 2909281 INFO (jetty-launcher-16579-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2909281 INFO (jetty-launcher-16579-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2909281 INFO (jetty-launcher-16579-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2909282 INFO (jetty-launcher-16579-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@78144175{/solr,null,AVAILABLE}
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@75db393c{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:34663}
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.e.j.s.Server Started @2909365ms
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34663}
[junit4] 2> 2909286 ERROR (jetty-launcher-16579-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.1.0
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2909286 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T14:13:45.280621Z
[junit4] 2> 2909293 INFO (jetty-launcher-16579-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2909293 INFO (jetty-launcher-16579-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2909293 INFO (jetty-launcher-16579-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@69a61fa4{/solr,null,AVAILABLE}
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6875ca60{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:33865}
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.e.j.s.Server Started @2909378ms
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33865}
[junit4] 2> 2909299 ERROR (jetty-launcher-16579-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.1.0
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2909299 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T14:13:45.293762Z
[junit4] 2> 2909332 INFO (zkConnectionManagerCallback-16581-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909332 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2909356 INFO (zkConnectionManagerCallback-16583-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909358 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2909389 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 2909393 WARN (jetty-launcher-16579-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@518a7d6c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 2909417 WARN (jetty-launcher-16579-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@78c30c07[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 2909420 INFO (jetty-launcher-16579-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41833/solr
[junit4] 2> 2909464 INFO (zkConnectionManagerCallback-16591-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909467 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 2909500 WARN (jetty-launcher-16579-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@34410c3f[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 2909501 INFO (zkConnectionManagerCallback-16593-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909521 WARN (jetty-launcher-16579-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@4980cb26[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 2909522 INFO (jetty-launcher-16579-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41833/solr
[junit4] 2> 2909541 INFO (zkConnectionManagerCallback-16601-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909559 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34663_solr
[junit4] 2> 2909560 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.Overseer Overseer (id=72317234718769158-127.0.0.1:34663_solr-n_0000000000) starting
[junit4] 2> 2909564 INFO (zkConnectionManagerCallback-16603-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909569 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33865_solr
[junit4] 2> 2909569 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 2909574 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.s.HadoopAuthPlugin Params: {delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, type=simple, zk-dt-secret-manager.enable=true, signer.secret.provider=zookeeper, delegation-token.json-mapper.AUTO_CLOSE_TARGET=false}
[junit4] 2> 2909605 INFO (zkCallback-16602-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2909629 INFO (zkConnectionManagerCallback-16608-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2909641 INFO (zkCallback-16592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2909642 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2909650 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41833/solr ready
[junit4] 2> 2909666 INFO (OverseerStateUpdate-72317234718769158-127.0.0.1:34663_solr-n_0000000000) [n:127.0.0.1:34663_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:34663_solr
[junit4] 2> 2909669 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:34663_solr as DOWN
[junit4] 2> 2909670 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2909670 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34663_solr
[junit4] 2> 2909671 INFO (zkCallback-16592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2909671 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 2909671 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.s.HadoopAuthPlugin Params: {delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, type=simple, zk-dt-secret-manager.enable=true, signer.secret.provider=zookeeper, delegation-token.json-mapper.AUTO_CLOSE_TARGET=false}
[junit4] 2> 2909673 INFO (zkCallback-16602-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2909677 INFO (zkCallback-16607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2909773 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 2909774 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 2909832 INFO (jetty-launcher-16579-thread-2-EventThread) [ ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 2909846 INFO (jetty-launcher-16579-thread-1-EventThread) [ ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 2910153 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2910157 INFO (zkConnectionManagerCallback-16616-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2910165 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2910166 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41833/solr ready
[junit4] 2> 2910172 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34663.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a5e6efd
[junit4] 2> 2910183 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2910199 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33865.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a5e6efd
[junit4] 2> 2910214 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34663.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a5e6efd
[junit4] 2> 2910214 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34663.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a5e6efd
[junit4] 2> 2910219 INFO (jetty-launcher-16579-thread-1) [n:127.0.0.1:34663_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_BFBD5DE26F9183BE-001/tempDir-001/node1/.
[junit4] 2> 2910239 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33865.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a5e6efd
[junit4] 2> 2910240 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33865.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a5e6efd
[junit4] 2> 2910242 INFO (jetty-launcher-16579-thread-2) [n:127.0.0.1:33865_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_BFBD5DE26F9183BE-001/tempDir-001/node2/.
[junit4] 2> 2910313 INFO (zkConnectionManagerCallback-16622-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2910333 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2910345 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41833/solr ready
[junit4] 2> 2910397 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenew
[junit4] 2> 2910473 WARN (qtp517806991-40802) [ ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: foo is trying to renew a token (solr-dt owner=foo, renewer=foo, realUser=, issueDate=1554387226406, maxDate=1554992026406, sequenceNumber=1, masterKeyId=4) with wrong password
[junit4] 2> 2910474 WARN (qtp517806991-40802) [ ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2910476 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenew
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDelegationWithHadoopAuth -Dtests.method=testDelegationTokenRenew -Dtests.seed=BFBD5DE26F9183BE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-GP -Dtests.timezone=America/North_Dakota/New_Salem -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.13s J2 | TestDelegationWithHadoopAuth.testDelegationTokenRenew <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<200> but was:<403>
[junit4] > at __randomizedtesting.SeedInfo.seed([BFBD5DE26F9183BE:8826A9FC575D5E1A]:0)
[junit4] > at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.renewDelegationToken(TestDelegationWithHadoopAuth.java:120)
[junit4] > at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.verifyDelegationTokenRenew(TestDelegationWithHadoopAuth.java:303)
[junit4] > at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenRenew(TestDelegationWithHadoopAuth.java:321)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:567)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] 2> 2910521 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancelFail-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancelFail
[junit4] 2> 2910537 WARN (qtp517806991-40800) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2910538 WARN (qtp517806991-40801) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2910566 WARN (qtp517806991-40802) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2910589 ERROR (qtp1313977039-40796) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_2]
[junit4] 2> 2910590 WARN (qtp517806991-40800) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2910591 ERROR (qtp517806991-40800) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_2]
[junit4] 2> 2910592 WARN (qtp517806991-40801) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2910624 ERROR (qtp1313977039-40795) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_3]
[junit4] 2> 2910625 WARN (qtp517806991-40802) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2910627 ERROR (qtp517806991-40802) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_3]
[junit4] 2> 2910628 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancelFail-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancelFail
[junit4] 2> 2910765 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenVerify
[junit4] 2> 2910765 WARN (qtp517806991-40800) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2910845 INFO (zkConnectionManagerCallback-16627-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2910873 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2910873 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41833/solr ready
[junit4] 2> 2910878 INFO (qtp1313977039-40797) [n:127.0.0.1:33865_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAWnostCHigFqDL9UhwQEFIlfGup46QljEVcqaiHRpd7Y5XC9B3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2910878 INFO (qtp1313977039-40797) [n:127.0.0.1:33865_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAWnostCHigFqDL9UhwQEFIlfGup46QljEVcqaiHRpd7Y5XC9B3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2910900 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ec244e8d000e, likely client has closed socket
[junit4] 2> 2910929 INFO (qtp1313977039-40795) [n:127.0.0.1:33865_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAWnostCHigFqDL9UhwQEFIlfGup46QljEVcqaiHRpd7Y5XC9B3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2910929 INFO (qtp1313977039-40795) [n:127.0.0.1:33865_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAWnostCHigFqDL9UhwQEFIlfGup46QljEVcqaiHRpd7Y5XC9B3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2910964 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenVerify
[junit4] 2> 2910994 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationOtherOp-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationOtherOp
[junit4] 2> 2911006 INFO (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params op=someSolrOperation&action=LIST&user.name=foo&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2911006 INFO (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={op=someSolrOperation&action=LIST&user.name=foo&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2911007 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationOtherOp-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationOtherOp
[junit4] 2> 2911047 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenSolrClient-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenSolrClient
[junit4] 2> 2911049 WARN (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911102 INFO (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAWnostGjigFqDL9VowUEFNQdNmhF6H0XRAsknpsCgkJk-capB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2911102 INFO (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAWnostGjigFqDL9VowUEFNQdNmhF6H0XRAsknpsCgkJk-capB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2911103 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenSolrClient-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenSolrClient
[junit4] 2> 2911137 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancel
[junit4] 2> 2911138 WARN (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911145 WARN (qtp517806991-40801) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911192 INFO (zkConnectionManagerCallback-16632-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2911193 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2911194 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41833/solr ready
[junit4] 2> 2911197 ERROR (qtp1313977039-40797) [n:127.0.0.1:33865_solr ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_6]
[junit4] 2> 2911264 INFO (zkConnectionManagerCallback-16637-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2911269 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2911269 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41833/solr ready
[junit4] 2> 2911280 WARN (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911301 ERROR (qtp1313977039-40796) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_7]
[junit4] 2> 2911349 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancel
[junit4] 2> 2911386 INFO (TEST-TestDelegationWithHadoopAuth.testZNodePaths-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testZNodePaths
[junit4] 2> 2911387 WARN (qtp517806991-40802) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911461 INFO (zkConnectionManagerCallback-16639-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2911469 INFO (TEST-TestDelegationWithHadoopAuth.testZNodePaths-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testZNodePaths
[junit4] 2> 2911512 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenewFail
[junit4] 2> 2911525 WARN (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911527 WARN (qtp517806991-40801) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911527 WARN (qtp517806991-40801) [ ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: bar tries to renew a token (solr-dt owner=foo, renewer=foo, realUser=, issueDate=1554387227519, maxDate=1554992027519, sequenceNumber=9, masterKeyId=4) with non-matching renewer foo
[junit4] 2> 2911528 WARN (qtp517806991-40801) [ ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2911529 WARN (qtp1313977039-40795) [n:127.0.0.1:33865_solr ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: bar tries to renew a token (solr-dt owner=foo, renewer=foo, realUser=, issueDate=1554387227519, maxDate=1554992027519, sequenceNumber=9, masterKeyId=4) with non-matching renewer foo
[junit4] 2> 2911529 WARN (qtp1313977039-40795) [n:127.0.0.1:33865_solr ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2911530 WARN (qtp517806991-40802) [ ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911535 WARN (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911535 WARN (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew a token (solr-dt owner=foo, renewer=renewUser, realUser=, issueDate=1554387227524, maxDate=1554992027524, sequenceNumber=10, masterKeyId=4) with non-matching renewer renewUser
[junit4] 2> 2911535 WARN (qtp517806991-40800) [n:127.0.0.1:34663_solr ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2911536 WARN (qtp1313977039-40797) [n:127.0.0.1:33865_solr ] o.a.h.s.a.s.AuthenticationFilter AuthenticationToken ignored: Unauthorized access
[junit4] 2> 2911536 WARN (qtp1313977039-40797) [n:127.0.0.1:33865_solr ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew a token (solr-dt owner=foo, renewer=renewUser, realUser=, issueDate=1554387227524, maxDate=1554992027524, sequenceNumber=10, masterKeyId=4) with non-matching renewer renewUser
[junit4] 2> 2911536 WARN (qtp1313977039-40797) [n:127.0.0.1:33865_solr ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2911537 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[BFBD5DE26F9183BE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenewFail
[junit4] 2> 2911549 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=109464326
[junit4] 2> 2911549 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34663_solr
[junit4] 2> 2911552 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.c.CoreContainer Publish this node as DOWN...
[junit4] 2> 2911552 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:34663_solr as DOWN
[junit4] 2> 2911565 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=960445410
[junit4] 2> 2911566 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33865_solr
[junit4] 2> 2911576 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2911576 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@27a531f8: rootName = solr_34663, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5f5742d0
[junit4] 2> 2911577 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.c.CoreContainer Publish this node as DOWN...
[junit4] 2> 2911577 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:33865_solr as DOWN
[junit4] 2> 2911581 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2911581 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6a949149: rootName = solr_34663, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4bc9071a
[junit4] 2> 2911583 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2911583 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@695a5025: rootName = solr_34663, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5d93dbe2
[junit4] 2> 2911583 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2911585 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2911593 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2911593 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@59a21246: rootName = solr_33865, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3244331
[junit4] 2> 2911597 INFO (closeThreadPool-16645-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72317234718769158-127.0.0.1:34663_solr-n_0000000000) closing
[junit4] 2> 2911597 INFO (OverseerStateUpdate-72317234718769158-127.0.0.1:34663_solr-n_0000000000) [n:127.0.0.1:34663_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34663_solr
[junit4] 2> 2911597 INFO (OverseerAutoScalingTriggerThread-72317234718769158-127.0.0.1:34663_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2911598 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2911598 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c635318: rootName = solr_33865, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4bc9071a
[junit4] 2> 2911600 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2911600 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@66cb8137: rootName = solr_33865, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5d93dbe2
[junit4] 2> 2911600 INFO (jetty-closer-16640-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2911621 INFO (zkCallback-16602-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2911624 INFO (zkCallback-16607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2911629 INFO (zkCallback-16602-thread-2) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33865_solr
[junit4] 2> 2911709 INFO (zkCallback-16607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2911761 INFO (zkCallback-16615-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 2911761 ERROR (Thread[Thread-7968,5,TGRP-TestDelegationWithHadoopAuth]) [ ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 2911764 INFO (Curator-Framework-0) [ ] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
[junit4] 2> 2911769 INFO (closeThreadPool-16645-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72317234718769158-127.0.0.1:34663_solr-n_0000000000) closing
[junit4] 2> 2911769 INFO (jetty-closer-16640-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72317234718769158-127.0.0.1:34663_solr-n_0000000000) closing
[junit4] 2> 2911777 ERROR (Thread[Thread-7966,5,TGRP-TestDelegationWithHadoopAuth]) [ ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 2911780 INFO (Curator-Framework-0) [ ] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
[junit4] 2> 2911781 INFO (jetty-closer-16640-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6875ca60{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 2911781 INFO (jetty-closer-16640-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@69a61fa4{/solr,null,UNAVAILABLE}
[junit4] 2> 2911781 INFO (jetty-closer-16640-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 2911783 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ec244e8d000b, likely client has closed socket
[junit4] 2> 2911783 INFO (jetty-closer-16640-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@75db393c{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 2911783 INFO (jetty-closer-16640-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@78144175{/solr,null,UNAVAILABLE}
[junit4] 2> 2911783 INFO (jetty-closer-16640-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 2911801 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 2911817 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/aliases.json
[junit4] 2> 8 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/clusterstate.json
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_7
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_6
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_9
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_8
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_5
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_10
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 8 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_BFBD5DE26F9183BE-001
[junit4] 2> 2911818 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:41833
[junit4] 2> 2911818 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[BFBD5DE26F9183BE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 41833
[junit4] 2> Apr 04, 2019 2:13:47 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene80), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@62d63dd1), locale=fr-GP, timezone=America/North_Dakota/New_Salem
[junit4] 2> NOTE: Linux 4.18.0-15-generic amd64/Oracle Corporation 12 (64-bit)/cpus=8,threads=1,free=105856656,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TestTlogReplica, ZkFailoverTest, PreAnalyzedFieldTest, CollectionTooManyReplicasTest, DebugComponentTest, TestValueSourceCache, CoreAdminHandlerTest, TestDocSet, AtomicUpdateProcessorFactoryTest, TestDistributedGrouping, TestInPlaceUpdatesStandalone, ZkSolrClientTest, TestCollationField, BJQParserTest, DeleteStatusTest, TestDynamicFieldCollectionResource, TestCharFilters, SearchRateTriggerIntegrationTest, BadCopyFieldTest, AdminHandlersProxyTest, TestJsonRequest, UpdateParamsTest, EmbeddedSolrNoSerializeTest, MetricsHistoryHandlerTest, TestXIncludeConfig, TestStressCloudBlindAtomicUpdates, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, SolrMetricsIntegrationTest, TestSolrCoreSnapshots, TestAddFieldRealTimeGet, TestDocumentBuilder, CheckHdfsIndexTest, TestDFRSimilarityFactory, PeerSyncReplicationTest, TestAnalyzeInfixSuggestions, DateFieldTest, TestHighFrequencyDictionaryFactory, OverseerCollectionConfigSetProcessorTest, PreAnalyzedUpdateProcessorTest, TestLegacyFieldCache, TestRetrieveFieldsOptimizer, TolerantUpdateProcessorTest, HdfsNNFailoverTest, ConvertedLegacyTest, FastVectorHighlighterTest, HdfsTlogReplayBufferedWhileIndexingTest, ConfigureRecoveryStrategyTest, TestRandomFlRTGCloud, TestCloudPivotFacet, BlockDirectoryTest, TestSimComputePlanAction, PhrasesIdentificationComponentTest, StressHdfsTest, DistributedTermsComponentTest, FullSolrCloudDistribCmdsTest, TestDynamicURP, ExternalFileFieldSortTest, BlockJoinFacetSimpleTest, LukeRequestHandlerTest, TestChildDocTransformerHierarchy, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestConfigSetImmutable, MoreLikeThisHandlerTest, TestPolicyCloud, NodeMutatorTest, ClassificationUpdateProcessorTest, TestSQLHandler, TestTrie, TestMultiWordSynonyms, TestLFUCache, TestCustomStream, TestManagedSchema, SliceStateTest, TestUninvertingReader, TestObjectReleaseTracker, ResourceLoaderTest, ChangedSchemaMergeTest, CdcrReplicationHandlerTest, TestShortCircuitedRequests, SolrRequestParserTest, TestQueryTypes, TestUtilizeNode, TestCloudDeleteByQuery, TestReplicationHandlerDiskOverFlow, TestLuceneIndexBackCompat, ResponseLogComponentTest, TestNamedUpdateProcessors, TestCoreContainer, IgnoreCommitOptimizeUpdateProcessorFactoryTest, ReindexCollectionTest, ShardRoutingCustomTest, TestHashPartitioner, CategoryRoutedAliasUpdateProcessorTest, TestJoin, TestLockTree, TestSlowCompositeReaderWrapper, TestQuerySenderNoQuery, TestInitParams, OrderedExecutorTest, ConcurrentDeleteAndCreateCollectionTest, V2StandaloneTest, TestSimpleTrackingShardHandler, JSONWriterTest, ManagedSchemaRoundRobinCloudTest, TestFastLRUCache, AssignBackwardCompatibilityTest, TestLogWatcher, TestStressRecovery, TestSchemaVersionResource, TestHashQParserPlugin, CollectionStateFormat2Test, TermVectorComponentTest, DistributedFacetPivotSmallAdvancedTest, SystemCollectionCompatTest, SignificantTermsQParserPluginTest, QueryParsingTest, TestNestedDocsSort, ZkStateWriterTest, HttpSolrCallGetCoreTest, TestEmbeddedSolrServerSchemaAPI, TestSimPolicyCloud, MoveReplicaTest, TriggerIntegrationTest, DistributedIntervalFacetingTest, ClusterStateTest, CircularListTest, DistributedMLTComponentTest, TestComplexPhraseQParserPlugin, TestSubQueryTransformerDistrib, HttpPartitionTest, DistributedQueryElevationComponentTest, TestOmitPositions, TestSchemalessBufferedUpdates, TestSimpleTextCodec, TestWriterPerf, TestReplicaProperties, TestRemoteStreaming, DistribJoinFromCollectionTest, DistributedVersionInfoTest, LeaderFailoverAfterPartitionTest, LegacyCloudClusterPropTest, MetricsHistoryIntegrationTest, MissingSegmentRecoveryTest, MultiSolrCloudTestCaseTest, OverseerStatusTest, RecoveryAfterSoftCommitTest, SSLMigrationTest, ShardRoutingTest, TestCloudPseudoReturnFields, TestCloudRecovery2, TestDeleteCollectionOnDownNodes, TestDistributedMap, TestDownShardTolerantSearch, TestLeaderElectionWithEmptyReplica, TestRebalanceLeaders, TestTolerantUpdateProcessorCloud, AssignTest, CollectionsAPIAsyncDistributedZkTest, SimpleCollectionCreateDeleteTest, TestCollectionsAPIViaSolrCloudCluster, AutoAddReplicasPlanActionTest, ComputePlanActionTest, NodeLostTriggerIntegrationTest, NodeMarkersRegistrationTest, ScheduledMaintenanceTriggerTest, ScheduledTriggerIntegrationTest, TriggerSetPropertiesIntegrationTest, TestSimExecutePlanAction, TestSimGenericDistributedQueue, BaseCdcrDistributedZkTest, CdcrBidirectionalTest, CdcrVersionReplicationTest, CoreSorterTest, DirectoryFactoryTest, ExitableDirectoryReaderTest, HdfsDirectoryFactoryTest, PluginInfoTest, QueryResultKeyTest, SOLR749Test, SolrCoreCheckLockOnStartupTest, TestBadConfig, TestCodecSupport, TestConfig, TestLazyCores, TestSolrDeletionPolicy1, TestSolrDeletionPolicy2, BinaryUpdateRequestHandlerTest, CSVRequestHandlerTest, DocumentAnalysisRequestHandlerTest, ResponseBuilderTest, TestBlobHandler, TestSQLHandlerNonCloud, TestSolrConfigHandlerCloud, XmlUpdateRequestHandlerTest, AutoscalingHistoryHandlerTest, DistributedFacetExistsSmallTest, SuggestComponentContextFilterQueryTest, TermsComponentTest, TestExportWriter, HighlighterTest, TestLegacyFieldReuse, TestLegacyNumericUtils, TestNumericRangeQuery64, SolrJmxReporterCloudTest, SolrShardReporterTest, TestCSVResponseWriter, TestGraphMLResponseWriter, TestPushWriter, TestRawResponseWriter, TestRestManager, TestFieldCollectionResource, TestFieldTypeResource, TestSerializedLuceneMatchVersion, TestManagedSynonymFilterFactory, DocValuesMissingTest, NotRequiredUniqueKeyTest, PolyFieldTest, SchemaApiFailureTest, SynonymTokenizerTest, TestBinaryField, TestBulkSchemaConcurrent, TestCollapseQParserPlugin, TestComponentsName, TestIndexSearcher, TestLRUCache, TestLegacyNumericRangeQueryBuilder, TestMaxScoreQueryParser, TestMinHashQParser, TestOverriddenPrefixQueryForCustomFieldType, TestPayloadCheckQParserPlugin, TestQueryUtils, TestRTGBase, TestRandomCollapseQParserPlugin, TestRecoveryHdfs, TestCloudJSONFacetSKG, TestJsonFacetsWithNestedObjects, SortByFunctionTest, TestMinMaxOnMultiValuedField, SimpleMLTQParserTest, TestBM25SimilarityFactory, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestLegacyBM25SimilarityFactory, TestNonDefinedSimilarityFactory, TestPerFieldSimilarity, TestPerFieldSimilarityWithDefaultOverride, TestSweetSpotSimilarityFactory, TestDistribIDF, TestExactSharedStatsCache, BasicAuthIntegrationTest, BasicAuthStandaloneTest, JWTAuthPluginIntegrationTest, TestPKIAuthenticationPlugin, TestRuleBasedAuthorizationPlugin, TestSha256AuthenticationProvider, TestDelegationWithHadoopAuth]
[junit4] Completed [768/847 (1!)] on J2 in 3.82s, 8 tests, 1 failure <<< FAILURES!
[...truncated 42818 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/346/consoleText
[repro] Revision: 4b86a396805ea690c9d31770ecaf783b38106000
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=TestDelegationWithHadoopAuth -Dtests.method=testDelegationTokenRenew -Dtests.seed=BFBD5DE26F9183BE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-GP -Dtests.timezone=America/North_Dakota/New_Salem -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestDelegationWithHadoopAuth
[repro] ant compile-test
[...truncated 3581 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestDelegationWithHadoopAuth" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=BFBD5DE26F9183BE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-GP -Dtests.timezone=America/North_Dakota/New_Salem -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 110 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth
[repro] Exiting with code 0
[...truncated 43 lines...]
[JENKINS] Lucene-Solr-8.x-Linux (64bit/jdk-11) - Build # 348 -
Still unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/348/
Java: 64bit/jdk-11 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitShardWithRule
Error Message:
Error from server at http://127.0.0.1:35321: Could not find collection : shardSplitWithRule_rewrite
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35321: Could not find collection : shardSplitWithRule_rewrite
at __randomizedtesting.SeedInfo.seed([8A91361DF7577660:B9FE7AF6AA52D4B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:649)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1055)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:830)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:763)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at org.apache.solr.cloud.api.collections.ShardSplitTest.doSplitShardWithRule(ShardSplitTest.java:661)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitShardWithRule(ShardSplitTest.java:628)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:834)
Build Log:
[...truncated 13707 lines...]
[junit4] Suite: org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/init-core-data-001
[junit4] 2> 810831 INFO (SUITE-ShardSplitTest-seed#[8A91361DF7577660]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 810831 INFO (SUITE-ShardSplitTest-seed#[8A91361DF7577660]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
[junit4] 2> 810831 INFO (SUITE-ShardSplitTest-seed#[8A91361DF7577660]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 810832 INFO (SUITE-ShardSplitTest-seed#[8A91361DF7577660]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 810834 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 810836 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 810836 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 810936 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer start zk server on port:41587
[junit4] 2> 810936 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:41587
[junit4] 2> 810936 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 41587
[junit4] 2> 811011 INFO (zkConnectionManagerCallback-4734-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 811059 INFO (zkConnectionManagerCallback-4736-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 811061 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 811072 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 811073 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 811073 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 811074 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 811074 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 811075 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 811075 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 811076 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 811076 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 811077 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 811077 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 811243 WARN (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 811244 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 811244 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 811244 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11+28
[junit4] 2> 811268 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 811268 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 811268 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 811271 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@794b0f31{/,null,AVAILABLE}
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@de2dec1{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:33137}
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.s.Server Started @811337ms
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/tempDir-001/control/data, hostPort=33137, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/control-001/cores, replicaType=NRT}
[junit4] 2> 811273 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 811273 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T22:38:58.496778Z
[junit4] 2> 811281 INFO (zkConnectionManagerCallback-4738-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 811282 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 811282 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/control-001/solr.xml
[junit4] 2> 811284 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 811284 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 811284 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 811381 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 811400 WARN (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@35e5e446[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 811415 WARN (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@cf86a78[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 811416 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41587/solr
[junit4] 2> 811427 INFO (zkConnectionManagerCallback-4745-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 811462 INFO (zkConnectionManagerCallback-4747-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 811503 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33137_
[junit4] 2> 811503 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer Overseer (id=72319221320646660-127.0.0.1:33137_-n_0000000000) starting
[junit4] 2> 811519 INFO (zkConnectionManagerCallback-4754-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 811524 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41587/solr ready
[junit4] 2> 811525 INFO (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:33137_
[junit4] 2> 811528 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 811528 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33137_
[junit4] 2> 811529 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0 #Completed tasks: 0
[junit4] 2> 811529 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 811529 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 811529 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 811529 INFO (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
[junit4] 2> 811529 INFO (zkCallback-4746-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 811542 INFO (zkCallback-4753-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 811544 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 811575 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 811592 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 811596 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 811597 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [n:127.0.0.1:33137_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/control-001/cores
[junit4] 2> 811695 INFO (zkConnectionManagerCallback-4760-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 811696 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 811696 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41587/solr ready
[junit4] 2> 811708 INFO (qtp1359148112-12481) [n:127.0.0.1:33137_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:33137_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 811709 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ecf]]
[junit4] 2> 811709 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000000] as running
[junit4] 2> 811709 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:33137_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 811720 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000000
[junit4] 2> 811720 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:33137_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 811720 INFO (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 811720 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1 #Completed tasks: 0
[junit4] 2> 811720 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 811720 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 811720 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 811720 INFO (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 811732 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler creating collections conf node /collections/control_collection
[junit4] 2> 811732 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Check for collection zkNode:control_collection
[junit4] 2> 811732 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Collection zkNode exists
[junit4] 2> 811736 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:33137_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 811736 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 811737 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/control_collection/state.json
[junit4] 2> 811837 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Creating SolrCores for new collection control_collection, shardNames [shard1] , message : {
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:33137_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 811838 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Creating core control_collection_shard1_replica_n1 as part of shard shard1 of collection control_collection on 127.0.0.1:33137_
[junit4] 2> 811840 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 811840 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 811845 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33137",
[junit4] 2> "node_name":"127.0.0.1:33137_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 811845 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33137",
[junit4] 2> "node_name":"127.0.0.1:33137_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 811845 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":"control_collection_shard1_replica_n1","base_url":"http://127.0.0.1:33137","node_name":"127.0.0.1:33137_","state":"down","type":"NRT"}
[junit4] 2> 811845 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(control_collection//collections/control_collection/state.json/0)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node2":{
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:33137",
[junit4] 2> "node_name":"127.0.0.1:33137_",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 811945 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 0
[junit4] 2> 812853 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
[junit4] 2> 812862 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 812924 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 812932 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 812933 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 812933 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 812935 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 812956 WARN (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 813005 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 813005 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 813007 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 813007 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 813008 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 813008 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2bccba49[control_collection_shard1_replica_n1] main]
[junit4] 2> 813009 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 813009 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 813010 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 813010 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629924926667358208
[junit4] 2> 813017 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 813017 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 813017 INFO (searcherExecutor-4166-thread-1-processing-n:127.0.0.1:33137_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@2bccba49[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 813019 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 813019 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 813019 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33137/control_collection_shard1_replica_n1/
[junit4] 2> 813019 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 813019 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:33137/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 813019 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72319221320646660-core_node2-n_0000000000
[junit4] 2> 813020 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33137/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 813021 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:33137",
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 813121 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 1
[junit4] 2> 813121 INFO (zkCallback-4746-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 813122 INFO (zkCallback-4746-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 813122 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 813122 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33137",
[junit4] 2> "node_name":"127.0.0.1:33137_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 813122 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33137",
[junit4] 2> "node_name":"127.0.0.1:33137_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 813122 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":"control_collection_shard1_replica_n1","base_url":"http://127.0.0.1:33137","node_name":"127.0.0.1:33137_","state":"active","type":"NRT","leader":"true"}
[junit4] 2> 813123 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(control_collection//collections/control_collection/state.json/2)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node2":{
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:33137",
[junit4] 2> "node_name":"127.0.0.1:33137_",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 813123 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1283
[junit4] 2> 813123 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Finished create command on all shards for collection: control_collection
[junit4] 2> 813124 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Completed task:[/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 813125 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000000] as completed.
[junit4] 2> 813125 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 813125 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 813125 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 813125 INFO (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 813125 DEBUG (OverseerThreadFactory-4161-thread-1-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={127.0.0.1:33137_={responseHeader={status=0,QTime=1283},core=control_collection_shard1_replica_n1}}}
[junit4] 2> 813127 INFO (qtp1359148112-12481) [n:127.0.0.1:33137_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 813223 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 2
[junit4] 2> 813223 INFO (zkCallback-4746-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 813223 INFO (zkCallback-4746-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 813223 INFO (zkCallback-4746-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 813223 INFO (qtp1359148112-12481) [n:127.0.0.1:33137_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:33137_&wt=javabin&version=2} status=0 QTime=1516
[junit4] 2> 813226 INFO (zkConnectionManagerCallback-4766-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 813226 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 813227 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41587/solr ready
[junit4] 2> 813227 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 813227 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 813228 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ed1]]
[junit4] 2> 813228 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000002] as running
[junit4] 2> 813228 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4] 2> "name":"collection1",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "createNodeSet":"",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 813228 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000002
[junit4] 2> 813228 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"collection1",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "createNodeSet":"",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 813228 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1 #Completed tasks: 1
[junit4] 2> 813228 INFO (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 813228 INFO (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 813229 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 813229 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 813229 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 813229 INFO (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 813229 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection1
[junit4] 2> 813229 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Check for collection zkNode:collection1
[junit4] 2> 813229 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Collection zkNode exists
[junit4] 2> 813232 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"collection1",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "createNodeSet":"",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 813232 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 813332 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 813432 WARN (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 813432 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.a.c.CreateCollectionCmd Finished create command for collection: collection1
[junit4] 2> 813433 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Completed task:[/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 813434 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 813434 INFO (qtp1359148112-12479) [n:127.0.0.1:33137_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=206
[junit4] 2> 813434 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ed1]]
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0 #Completed tasks: 1
[junit4] 2> 813435 INFO (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 813435 INFO (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0 #Completed tasks: 0
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 813435 DEBUG (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 813435 INFO (OverseerCollectionConfigSetProcessor-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
[junit4] 2> 813436 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000002] as completed.
[junit4] 2> 813436 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 813436 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 813436 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 813436 INFO (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
[junit4] 2> 813436 DEBUG (OverseerThreadFactory-4161-thread-2-processing-n:127.0.0.1:33137_) [n:127.0.0.1:33137_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Message id:/overseer/collection-queue-work/qn-0000000002 complete, response:{}
[junit4] 2> 813436 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4
[junit4] 2> 813643 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-1-001 of type NRT
[junit4] 2> 813662 WARN (closeThreadPool-4767-thread-1) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 813663 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 813671 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 813672 INFO (closeThreadPool-4767-thread-1) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11+28
[junit4] 2> 813711 INFO (closeThreadPool-4767-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 813711 INFO (closeThreadPool-4767-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 813712 INFO (closeThreadPool-4767-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 813718 INFO (closeThreadPool-4767-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@75913939{/,null,AVAILABLE}
[junit4] 2> 813720 INFO (closeThreadPool-4767-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2934c93a{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:44149}
[junit4] 2> 813720 INFO (closeThreadPool-4767-thread-1) [ ] o.e.j.s.Server Started @813783ms
[junit4] 2> 813720 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/tempDir-001/jetty1, hostPort=44149, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-1-001/cores}
[junit4] 2> 813726 ERROR (closeThreadPool-4767-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 813726 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 813726 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0
[junit4] 2> 813726 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 813726 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 813726 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T22:39:00.949553Z
[junit4] 2> 813762 INFO (zkConnectionManagerCallback-4769-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 813765 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 813765 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-1-001/solr.xml
[junit4] 2> 813767 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 813767 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 813785 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100edf2d9400008, likely client has closed socket
[junit4] 2> 813785 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 813891 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-2-001 of type NRT
[junit4] 2> 813906 WARN (closeThreadPool-4767-thread-2) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 813906 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 813906 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 813906 INFO (closeThreadPool-4767-thread-2) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11+28
[junit4] 2> 814014 INFO (closeThreadPool-4767-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 814014 INFO (closeThreadPool-4767-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 814014 INFO (closeThreadPool-4767-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3c6ddca3{/,null,AVAILABLE}
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@66808118{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:46625}
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.e.j.s.Server Started @814088ms
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/tempDir-001/jetty2, hostPort=46625, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-2-001/cores}
[junit4] 2> 814024 ERROR (closeThreadPool-4767-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 814024 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T22:39:01.247865Z
[junit4] 2> 814037 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 814043 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-3-001 of type NRT
[junit4] 2> 814062 INFO (zkConnectionManagerCallback-4772-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814063 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 814063 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-2-001/solr.xml
[junit4] 2> 814065 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 814065 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 814066 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 814072 WARN (closeThreadPool-4767-thread-3) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 814072 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 814072 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 814072 INFO (closeThreadPool-4767-thread-3) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11+28
[junit4] 2> 814077 WARN (closeThreadPool-4767-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@7e34ba92[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 814148 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 814166 WARN (closeThreadPool-4767-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@563b477[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 814167 INFO (closeThreadPool-4767-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41587/solr
[junit4] 2> 814201 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[8A91361DF7577660]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-4-001 of type NRT
[junit4] 2> 814228 WARN (closeThreadPool-4767-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@2a3e218a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 814250 WARN (closeThreadPool-4767-thread-4) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 814250 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 814250 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 814250 INFO (closeThreadPool-4767-thread-4) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11+28
[junit4] 2> 814295 INFO (zkConnectionManagerCallback-4780-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814308 INFO (closeThreadPool-4767-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 814308 INFO (closeThreadPool-4767-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 814308 INFO (closeThreadPool-4767-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 814336 WARN (closeThreadPool-4767-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@7e4094e8[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ec7d6f9{/,null,AVAILABLE}
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41587/solr
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@86f8d23{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:39051}
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.e.j.s.Server Started @814401ms
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/tempDir-001/jetty3, hostPort=39051, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-3-001/cores}
[junit4] 2> 814337 ERROR (closeThreadPool-4767-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 814337 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T22:39:01.560946Z
[junit4] 2> 814338 INFO (closeThreadPool-4767-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 814338 INFO (closeThreadPool-4767-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 814338 INFO (closeThreadPool-4767-thread-4) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 814338 INFO (zkConnectionManagerCallback-4783-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51ceb0{/,null,AVAILABLE}
[junit4] 2> 814339 INFO (zkConnectionManagerCallback-4789-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814339 INFO (zkConnectionManagerCallback-4787-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4dfdcedb{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:43135}
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.e.j.s.Server Started @814403ms
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/tempDir-001/jetty4, hostPort=43135, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-4-001/cores}
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-3-001/solr.xml
[junit4] 2> 814339 ERROR (closeThreadPool-4767-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 814339 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T22:39:01.562651Z
[junit4] 2> 814341 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 814341 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 814342 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 814353 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 814360 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.c.ZkController Publish node=127.0.0.1:44149_ as DOWN
[junit4] 2> 814360 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 814360 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44149_
[junit4] 2> 814361 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:44149_"} current state version: 0
[junit4] 2> 814361 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:44149_
[junit4] 2> 814361 INFO (zkCallback-4753-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 814361 INFO (zkCallback-4746-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 814372 INFO (zkCallback-4765-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 814372 INFO (zkConnectionManagerCallback-4796-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814372 INFO (zkCallback-4782-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 814372 INFO (zkConnectionManagerCallback-4791-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814373 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 814373 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-4-001/solr.xml
[junit4] 2> 814374 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 814375 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 814375 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 814375 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.c.ZkController Publish node=127.0.0.1:46625_ as DOWN
[junit4] 2> 814375 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 814375 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46625_
[junit4] 2> 814375 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:46625_"} current state version: 0
[junit4] 2> 814375 DEBUG (OverseerStateUpdate-72319221320646660-127.0.0.1:33137_-n_0000000000) [n:127.0.0.1:33137_ ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:46625_
[junit4] 2> 814375 INFO (closeThreadPool-4767-thread-4) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 814376 INFO (zkCallback-4746-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 814376 INFO (zkCallback-4753-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 814376 INFO (zkCallback-4765-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 814380 INFO (zkCallback-4782-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 814384 INFO (zkConnectionManagerCallback-4801-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814384 INFO (zkCallback-4795-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 814385 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 814385 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41587/solr ready
[junit4] 2> 814386 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 814388 INFO (zkConnectionManagerCallback-4810-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 814389 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 814389 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41587/solr ready
[junit4] 2> 814395 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 814395 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 814405 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 814405 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 814406 INFO (closeThreadPool-4767-thread-1) [n:127.0.0.1:44149_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001/shard-1-001/cores
[junit4] 2> 814410 INFO (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@38c54991
[junit4] 2> 814410 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 814410 WARN (closeThreadPool-4767-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@72445525[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 814412 WARN (closeThreadPool-4767-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@233fff82[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 814413 INFO (closeThreadPool-4767-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41587/solr
[junit4] 2> 814417 WARN (closeThreadPool-4767-thread-2) [n:127.0.0.1:46625_ ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
[junit4] 2> => javax.management.InstanceNotFoundException: solr:dom1=jvm,name0=memory,name1=heap,name=usage
[junit4] 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083)
[junit4] 2> javax.management.InstanceNotFoundException: solr:dom1=jvm,name0=memory,name1=heap,name=usage
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083) ~[?:?]
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423) ~[?:?]
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411) ~[?:?]
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) ~[?:?]
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:531) ~[java/:?]
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:569) ~[java/:?]
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:742) ~[java/:?]
[junit4] 2> at java.util.HashMap.forEach(HashMap.java:1336) ~[?:?]
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:732) ~[java/:?]
[junit4] 2> at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:110) ~[java/:?]
[junit4] 2> at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70) ~[java/:?]
[junit4] 2> at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:916) ~[java/:?]
[junit4] 2> at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:843) ~[java/:?]
[junit4] 2> at org.apache.solr.core.CoreContainer.load(CoreContainer.java:605) ~[java/:?]
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:252) ~[java/:?]
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:172) ~[java/:?]
[junit4] 2> at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:136) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
[junit4] 2> at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterat
[...truncated too long message...]
ce to tell if we've missed updates
[junit4] 2> 1015270 INFO (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.c.RecoveryStrategy PeerSync Recovery was not successful - trying replication.
[junit4] 2> 1015270 INFO (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.c.RecoveryStrategy RecoveryStrategy has been closed
[junit4] 2> 1015270 INFO (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[false]
[junit4] 2> 1015270 INFO (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.c.SolrCore [collection1_shard1_1_replica_n0] CLOSING SolrCore org.apache.solr.core.SolrCore@38b2d02b
[junit4] 2> 1015270 INFO (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1_1.replica_n0, tag=38b2d02b
[junit4] 2> 1015270 INFO (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@126135df: rootName = null, domain = solr.core.collection1.shard1_1.replica_n0, service url = null, agent id = null] for registry solr.core.collection1.shard1_1.replica_n0 / com.codahale.metrics.MetricRegistry@1dd0f218
[junit4] 2> 1015280 INFO (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1_1.leader, tag=38b2d02b
[junit4] 2> 1015280 WARN (recoveryExecutor-5813-thread-1-processing-n:127.0.0.1:46057_ x:collection1_shard1_1_replica_n0 c:collection1 s:shard1_1 r:core_node20) [n:127.0.0.1:46057_ c:collection1 s:shard1_1 r:core_node20 x:collection1_shard1_1_replica_n0] o.a.s.c.RecoveryStrategy Stopping recovery for core=[collection1_shard1_1_replica_n0] coreNodeName=[core_node20]
[junit4] 2> 1015283 INFO (closeThreadPool-5931-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7e1a9707{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1015283 INFO (closeThreadPool-5931-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7a2017a3{/,null,UNAVAILABLE}
[junit4] 2> 1015283 INFO (closeThreadPool-5931-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1015284 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1015285 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 27 /solr/collections/collection1/state.json
[junit4] 2> 12 /solr/collections/collection1/terms/shard1_1
[junit4] 2> 12 /solr/aliases.json
[junit4] 2> 9 /solr/collections/collection1/terms/shard1_0
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2> 5 /solr/collections/collection1/terms/shard1
[junit4] 2> 5 /solr/collections/collection1/terms/shard2
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/clusterprops.json
[junit4] 2> 12 /solr/clusterstate.json
[junit4] 2> 5 /solr/collections/control_collection/state.json
[junit4] 2> 2 /solr/overseer_elect/election/72319233172242444-127.0.0.1:46771_-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/live_nodes
[junit4] 2> 12 /solr/collections
[junit4] 2>
[junit4] 2> 1015286 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34001
[junit4] 2> 1015286 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[8A91361DF7577660]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34001
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_8A91361DF7577660-001
[junit4] 2> Apr 04, 2019 10:42:22 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene80): {rnd_b=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=LuceneVarGapDocFreqInterval), _root_=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=PostingsFormat(name=Asserting), foo_s=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{rnd_b=DocValuesFormat(name=Lucene80), _version_=DocValuesFormat(name=Direct), a_t=DocValuesFormat(name=Direct), _root_=DocValuesFormat(name=Direct), a_i=DocValuesFormat(name=Lucene80), id=DocValuesFormat(name=Lucene80), foo_s=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1188, maxMBSortInHeap=5.57285734363135, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7f985ee0), locale=lkt, timezone=Indian/Comoro
[junit4] 2> NOTE: Linux 4.18.0-15-generic amd64/Oracle Corporation 11 (64-bit)/cpus=8,threads=1,free=128075304,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TriggerIntegrationTest, HdfsBasicDistributedZkTest, SolrCoreTest, TestStressCloudBlindAtomicUpdates, FastVectorHighlighterTest, TestSimpleTrackingShardHandler, TestUtils, TestSimPolicyCloud, BasicDistributedZkTest, TolerantUpdateProcessorTest, TestSimComputePlanAction, TestLockTree, TestCloudDeleteByQuery, TestTrie, TestPayloadCheckQParserPlugin, TestConfigSetImmutable, TestSolrCLIRunExample, TestCollectionsAPIViaSolrCloudCluster, TestOrdValues, JSONWriterTest, UniqFieldsUpdateProcessorFactoryTest, SolrJmxReporterCloudTest, TestFileDictionaryLookup, TestPKIAuthenticationPlugin, SpellCheckCollatorWithCollapseTest, DeleteStatusTest, SystemCollectionCompatTest, TestUtilizeNode, TestDocSet, PeerSyncWithLeaderTest, TestCollationField, TestManagedStopFilterFactory, CircularListTest, TestChildDocTransformerHierarchy, TestOmitPositions, BigEndianAscendingWordSerializerTest, SolrTestCaseJ4Test, TestConfigsApi, MoreLikeThisHandlerTest, TestPerFieldSimilarity, IgnoreCommitOptimizeUpdateProcessorFactoryTest, CdcrWithNodesRestartsTest, TestCloudJSONFacetJoinDomain, TestRandomCollapseQParserPlugin, TestSubQueryTransformerDistrib, TestLMJelinekMercerSimilarityFactory, ResponseLogComponentTest, ConcurrentDeleteAndCreateCollectionTest, TestReplicaProperties, TestJsonRequest, TestDFRSimilarityFactory, AutoAddReplicasPlanActionTest, PeerSyncReplicationTest, DateFieldTest, TestBulkSchemaConcurrent, TestRetrieveFieldsOptimizer, SolrRequestParserTest, TestSuggestSpellingConverter, BasicAuthIntegrationTest, HdfsRestartWhileUpdatingTest, PhrasesIdentificationComponentTest, LukeRequestHandlerTest, TestMaxScoreQueryParser, HttpPartitionTest, TestUninvertingReader, TestLegacyFieldCache, TestUseDocValuesAsStored2, CollectionStateFormat2Test, SolrXmlInZkTest, NodeLostTriggerTest, TestDocumentBuilder, TestCryptoKeys, ReplaceNodeTest, TestAnalyzeInfixSuggestions, TestSolrCoreSnapshots, TestCustomStream, SuggesterTSTTest, MetricsHistoryHandlerTest, SolrCmdDistributorTest, TestMergePolicyConfig, BlockDirectoryTest, ShardSplitTest]
[junit4] Completed [280/847 (1!)] on J2 in 204.74s, 11 tests, 1 error, 3 skipped <<< FAILURES!
[...truncated 44500 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/348/consoleText
[repro] Revision: 28e8a30b536a39e5539ac6e8b9407d31724c8857
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=ShardSplitTest -Dtests.method=testSplitShardWithRule -Dtests.seed=8A91361DF7577660 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lkt -Dtests.timezone=Indian/Comoro -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] ShardSplitTest
[repro] ant compile-test
[...truncated 3581 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ShardSplitTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=8A91361DF7577660 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lkt -Dtests.timezone=Indian/Comoro -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 140 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.api.collections.ShardSplitTest
[repro] Exiting with code 0
[...truncated 43 lines...]
[JENKINS] Lucene-Solr-8.x-Linux (64bit/jdk1.8.0_172) - Build # 347
- Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/347/
Java: 64bit/jdk1.8.0_172 -XX:-UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.SaslZkACLProviderTest
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 1) Thread[id=27716, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) 2) Thread[id=27713, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) 3) Thread[id=27709, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest:
1) Thread[id=27716, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
2) Thread[id=27713, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
3) Thread[id=27709, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
at __randomizedtesting.SeedInfo.seed([FDCEB798DCEC9BBA]:0)
FAILED: org.apache.solr.cloud.ReindexCollectionTest.testFailure
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([FDCEB798DCEC9BBA:95734474E6DCF915]:0)
at org.apache.solr.cloud.ReindexCollectionTest.lambda$testFailure$9(ReindexCollectionTest.java:305)
at org.apache.solr.common.cloud.ClusterState.lambda$forEachCollection$0(ClusterState.java:359)
at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
at org.apache.solr.common.cloud.ClusterState.forEachCollection(ClusterState.java:357)
at org.apache.solr.cloud.ReindexCollectionTest.testFailure(ReindexCollectionTest.java:304)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider
Error Message:
KeeperErrorCode = AuthFailed for /solr
Stack Trace:
org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for /solr
at __randomizedtesting.SeedInfo.seed([FDCEB798DCEC9BBA:F93AE14045A838B4]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:792)
at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$8(SolrZkClient.java:545)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:544)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:436)
at org.apache.solr.cloud.SaslZkACLProviderTest.setUp(SaslZkACLProviderTest.java:84)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:972)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13312 lines...]
[junit4] Suite: org.apache.solr.cloud.ReindexCollectionTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/init-core-data-001
[junit4] 2> 633741 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 633757 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 633758 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 633758 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001
[junit4] 2> 633758 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 633773 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 633773 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 633873 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:37705
[junit4] 2> 633873 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:37705
[junit4] 2> 633873 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 37705
[junit4] 2> 633938 INFO (zkConnectionManagerCallback-2937-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 633986 INFO (zkConnectionManagerCallback-2939-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634021 INFO (zkConnectionManagerCallback-2941-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634033 WARN (jetty-launcher-2942-thread-1) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 634034 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 634034 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 634034 INFO (jetty-launcher-2942-thread-1) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
[junit4] 2> 634049 WARN (jetty-launcher-2942-thread-2) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
[junit4] 2> 634050 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
[junit4] 2> 634050 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 634050 INFO (jetty-launcher-2942-thread-2) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
[junit4] 2> 634166 INFO (jetty-launcher-2942-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 634166 INFO (jetty-launcher-2942-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 634166 INFO (jetty-launcher-2942-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 634173 INFO (jetty-launcher-2942-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6420c35{/solr,null,AVAILABLE}
[junit4] 2> 634174 WARN (jetty-launcher-2942-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@118dcc73[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 634220 INFO (jetty-launcher-2942-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 634220 INFO (jetty-launcher-2942-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3155927c{SSL,[ssl, http/1.1]}{127.0.0.1:35045}
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.e.j.s.Server Started @634325ms
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35045}
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@724ba26b{/solr,null,AVAILABLE}
[junit4] 2> 634221 ERROR (jetty-launcher-2942-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 634221 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T18:26:12.959Z
[junit4] 2> 634221 WARN (jetty-launcher-2942-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@1dde127d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4778e658{SSL,[ssl, http/1.1]}{127.0.0.1:38933}
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.e.j.s.Server Started @634357ms
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38933}
[junit4] 2> 634253 ERROR (jetty-launcher-2942-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 634253 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-04T18:26:12.991Z
[junit4] 2> 634269 INFO (zkConnectionManagerCallback-2944-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634269 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 634328 INFO (zkConnectionManagerCallback-2946-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634329 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 634417 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 634417 WARN (jetty-launcher-2942-thread-2) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
[junit4] 2> 634434 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 634435 WARN (jetty-launcher-2942-thread-1) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
[junit4] 2> 634437 WARN (jetty-launcher-2942-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@5f8d412c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 634437 WARN (jetty-launcher-2942-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@3dcec003[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 634445 WARN (jetty-launcher-2942-thread-1) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
[junit4] 2> 634457 WARN (jetty-launcher-2942-thread-2) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
[junit4] 2> 634501 WARN (jetty-launcher-2942-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@56adeed1[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 634502 INFO (jetty-launcher-2942-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37705/solr
[junit4] 2> 634521 WARN (jetty-launcher-2942-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@5af930dd[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 634522 INFO (jetty-launcher-2942-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37705/solr
[junit4] 2> 634590 INFO (zkConnectionManagerCallback-2960-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634600 INFO (zkConnectionManagerCallback-2957-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634637 INFO (zkConnectionManagerCallback-2962-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634677 INFO (zkConnectionManagerCallback-2964-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634679 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35045_solr
[junit4] 2> 634679 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.Overseer Overseer (id=72318227430899719-127.0.0.1:35045_solr-n_0000000000) starting
[junit4] 2> 634694 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38933_solr
[junit4] 2> 634702 INFO (zkCallback-2963-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 634722 INFO (zkConnectionManagerCallback-2971-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634725 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 634727 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37705/solr ready
[junit4] 2> 634737 INFO (zkCallback-2961-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 634749 INFO (OverseerStateUpdate-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:35045_solr
[junit4] 2> 634757 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:35045_solr as DOWN
[junit4] 2> 634757 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 634757 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35045_solr
[junit4] 2> 634789 INFO (zkCallback-2961-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 634789 INFO (zkCallback-2963-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 634801 INFO (zkConnectionManagerCallback-2978-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634802 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 634802 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37705/solr ready
[junit4] 2> 634803 INFO (zkCallback-2970-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 634829 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 634852 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 634865 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35045.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 634902 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38933.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 634902 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35045.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 634903 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35045.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 634903 INFO (jetty-launcher-2942-thread-2) [n:127.0.0.1:35045_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node2/.
[junit4] 2> 634911 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38933.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 634911 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38933.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 634912 INFO (jetty-launcher-2942-thread-1) [n:127.0.0.1:38933_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node1/.
[junit4] 2> 634972 INFO (zkConnectionManagerCallback-2985-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 634973 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 634974 INFO (SUITE-ReindexCollectionTest-seed#[FDCEB798DCEC9BBA]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37705/solr ready
[junit4] 2> 634993 INFO (TEST-ReindexCollectionTest.testFailure-seed#[FDCEB798DCEC9BBA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testFailure
[junit4] 2> 635044 INFO (zkConnectionManagerCallback-2990-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 635046 INFO (TEST-ReindexCollectionTest.testFailure-seed#[FDCEB798DCEC9BBA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 635046 INFO (TEST-ReindexCollectionTest.testFailure-seed#[FDCEB798DCEC9BBA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37705/solr ready
[junit4] 2> 635082 INFO (qtp1340283966-9367) [n:127.0.0.1:35045_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&maxShardsPerNode=-1&name=failReindexing&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 635097 INFO (OverseerThreadFactory-2519-thread-1-processing-n:127.0.0.1:35045_solr) [n:127.0.0.1:35045_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection failReindexing
[junit4] 2> 635200 INFO (OverseerStateUpdate-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"failReindexing",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"failReindexing_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35045/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 635201 INFO (OverseerStateUpdate-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"failReindexing",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"failReindexing_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38933/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 635202 INFO (OverseerStateUpdate-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"failReindexing",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"failReindexing_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35045/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 635204 INFO (OverseerStateUpdate-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"failReindexing",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"failReindexing_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38933/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 635430 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr x:failReindexing_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n1&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 635523 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr x:failReindexing_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n2&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 635524 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr x:failReindexing_shard1_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 635537 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr x:failReindexing_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n6&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 635545 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr x:failReindexing_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n4&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 636545 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
[junit4] 2> 636545 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
[junit4] 2> 636596 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
[junit4] 2> 636598 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.IndexSchema [failReindexing_shard1_replica_n1] Schema name=minimal
[junit4] 2> 636602 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.s.IndexSchema [failReindexing_shard1_replica_n2] Schema name=minimal
[junit4] 2> 636602 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
[junit4] 2> 636604 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 636605 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 636605 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard1_replica_n1' using configuration from collection failReindexing, trusted=true
[junit4] 2> 636605 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35045.solr.core.failReindexing.shard1.replica_n1' (registry 'solr.core.failReindexing.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 636605 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SolrCore [[failReindexing_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node2/failReindexing_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node2/./failReindexing_shard1_replica_n1/data/]
[junit4] 2> 636606 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.s.IndexSchema [failReindexing_shard2_replica_n6] Schema name=minimal
[junit4] 2> 636608 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 636608 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard2_replica_n6' using configuration from collection failReindexing, trusted=true
[junit4] 2> 636608 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38933.solr.core.failReindexing.shard2.replica_n6' (registry 'solr.core.failReindexing.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 636608 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.c.SolrCore [[failReindexing_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node1/failReindexing_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node1/./failReindexing_shard2_replica_n6/data/]
[junit4] 2> 636609 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard1_replica_n2' using configuration from collection failReindexing, trusted=true
[junit4] 2> 636610 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38933.solr.core.failReindexing.shard1.replica_n2' (registry 'solr.core.failReindexing.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 636612 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.s.IndexSchema [failReindexing_shard2_replica_n4] Schema name=minimal
[junit4] 2> 636613 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.c.SolrCore [[failReindexing_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node1/failReindexing_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node1/./failReindexing_shard1_replica_n2/data/]
[junit4] 2> 636660 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 636661 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard2_replica_n4' using configuration from collection failReindexing, trusted=true
[junit4] 2> 636661 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35045.solr.core.failReindexing.shard2.replica_n4' (registry 'solr.core.failReindexing.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 636661 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.SolrCore [[failReindexing_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node2/failReindexing_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node2/./failReindexing_shard2_replica_n4/data/]
[junit4] 2> 636757 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 636757 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 636759 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 636759 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 636760 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@6c0a6544[failReindexing_shard2_replica_n4] main]
[junit4] 2> 636761 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 636761 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 636762 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 636762 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629909025292288000
[junit4] 2> 636765 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 636765 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 636767 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 636767 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 636768 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@6f5027bf[failReindexing_shard1_replica_n2] main]
[junit4] 2> 636768 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 636768 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 636769 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 636769 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629909025299628032
[junit4] 2> 636772 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 636772 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 636774 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard2 to Terms{values={core_node7=0}, version=0}
[junit4] 2> 636774 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 636774 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard2
[junit4] 2> 636774 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 636775 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5833b977[failReindexing_shard1_replica_n1] main]
[junit4] 2> 636776 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 636776 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 636776 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 636776 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629909025306968064
[junit4] 2> 636777 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 636777 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 636777 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 636779 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 636779 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 636781 INFO (searcherExecutor-2529-thread-1-processing-n:127.0.0.1:38933_solr x:failReindexing_shard1_replica_n2 c:failReindexing s:shard1 r:core_node5) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.c.SolrCore [failReindexing_shard1_replica_n2] Registered new searcher Searcher@6f5027bf[failReindexing_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 636781 INFO (searcherExecutor-2530-thread-1-processing-n:127.0.0.1:35045_solr x:failReindexing_shard2_replica_n4 c:failReindexing s:shard2 r:core_node7) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.SolrCore [failReindexing_shard2_replica_n4] Registered new searcher Searcher@6c0a6544[failReindexing_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 636781 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@66b1b4e3[failReindexing_shard2_replica_n6] main]
[junit4] 2> 636782 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 636785 INFO (searcherExecutor-2527-thread-1-processing-n:127.0.0.1:35045_solr x:failReindexing_shard1_replica_n1 c:failReindexing s:shard1 r:core_node3) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SolrCore [failReindexing_shard1_replica_n1] Registered new searcher Searcher@5833b977[failReindexing_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 636793 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 636793 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 636793 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629909025324793856
[junit4] 2> 636794 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 636794 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard1
[junit4] 2> 636798 INFO (searcherExecutor-2528-thread-1-processing-n:127.0.0.1:38933_solr x:failReindexing_shard2_replica_n6 c:failReindexing s:shard2 r:core_node8) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.c.SolrCore [failReindexing_shard2_replica_n6] Registered new searcher Searcher@66b1b4e3[failReindexing_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 636805 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
[junit4] 2> 636805 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard1
[junit4] 2> 636806 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
[junit4] 2> 636806 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard2
[junit4] 2> 636807 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 636807 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 636807 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35045/solr/failReindexing_shard1_replica_n1/
[junit4] 2> 636807 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard1_replica_n1 url=https://127.0.0.1:35045/solr START replicas=[https://127.0.0.1:38933/solr/failReindexing_shard1_replica_n2/] nUpdates=100
[junit4] 2> 636824 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard1_replica_n1 url=https://127.0.0.1:35045/solr DONE. We have no versions. sync failed.
[junit4] 2> 636860 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.c.S.Request [failReindexing_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 636868 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 636868 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 636869 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/failReindexing/leaders/shard1/leader after winning as /collections/failReindexing/leader_elect/shard1/election/72318227430899719-core_node3-n_0000000000
[junit4] 2> 636869 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35045/solr/failReindexing_shard1_replica_n1/ shard1
[junit4] 2> 636977 INFO (zkCallback-2961-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 636977 INFO (zkCallback-2961-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 636978 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 636992 ERROR (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.c.ZkStateReader Collection failReindexing is not lazy or watched!
[junit4] 2> 637047 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n1&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1617
[junit4] 2> 637097 INFO (zkCallback-2961-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637097 INFO (zkCallback-2961-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637097 INFO (zkCallback-2961-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637281 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 637281 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 637281 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35045/solr/failReindexing_shard2_replica_n4/
[junit4] 2> 637281 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard2_replica_n4 url=https://127.0.0.1:35045/solr START replicas=[https://127.0.0.1:38933/solr/failReindexing_shard2_replica_n6/] nUpdates=100
[junit4] 2> 637281 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard2_replica_n4 url=https://127.0.0.1:35045/solr DONE. We have no versions. sync failed.
[junit4] 2> 637283 INFO (qtp173184980-9371) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.c.S.Request [failReindexing_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 637284 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 637284 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 637284 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/failReindexing/leaders/shard2/leader after winning as /collections/failReindexing/leader_elect/shard2/election/72318227430899719-core_node7-n_0000000000
[junit4] 2> 637284 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35045/solr/failReindexing_shard2_replica_n4/ shard2
[junit4] 2> 637393 INFO (zkCallback-2961-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637393 INFO (zkCallback-2961-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637393 INFO (zkCallback-2961-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637394 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 637395 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n4&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1849
[junit4] 2> 637512 INFO (zkCallback-2961-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637512 INFO (zkCallback-2961-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637512 INFO (zkCallback-2961-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637880 INFO (qtp173184980-9373) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n6&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2343
[junit4] 2> 637880 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n2&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2357
[junit4] 2> 637886 INFO (qtp1340283966-9367) [n:127.0.0.1:35045_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 637910 INFO (zkCallback-2963-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637910 INFO (zkCallback-2961-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637910 INFO (zkCallback-2963-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637910 INFO (zkCallback-2961-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637910 INFO (zkCallback-2961-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
[junit4] 2> 637914 INFO (qtp1340283966-9367) [n:127.0.0.1:35045_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&maxShardsPerNode=-1&name=failReindexing&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2831
[junit4] 2> 637945 INFO (qtp1340283966-9366) [n:127.0.0.1:35045_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&maxShardsPerNode=-1&name=failReindexingTarget&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 637970 INFO (OverseerCollectionConfigSetProcessor-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 637970 INFO (OverseerThreadFactory-2519-thread-2-processing-n:127.0.0.1:35045_solr) [n:127.0.0.1:35045_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection failReindexingTarget
[junit4] 2> 638179 INFO (OverseerStateUpdate-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"failReindexingTarget",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"failReindexingTarget_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38933/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 638390 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr x:failReindexingTarget_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=failReindexingTarget_shard1_replica_n1&action=CREATE&numShards=1&collection=failReindexingTarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 639531 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
[junit4] 2> 639540 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.IndexSchema [failReindexingTarget_shard1_replica_n1] Schema name=minimal
[junit4] 2> 639542 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 639542 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'failReindexingTarget_shard1_replica_n1' using configuration from collection failReindexingTarget, trusted=true
[junit4] 2> 639542 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38933.solr.core.failReindexingTarget.shard1.replica_n1' (registry 'solr.core.failReindexingTarget.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d3d2b87
[junit4] 2> 639542 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SolrCore [[failReindexingTarget_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node1/failReindexingTarget_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_FDCEB798DCEC9BBA-001/tempDir-001/node1/./failReindexingTarget_shard1_replica_n1/data/]
[junit4] 2> 639667 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 639667 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 639670 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 639670 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 639671 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6bf51b6b[failReindexingTarget_shard1_replica_n1] main]
[junit4] 2> 639672 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 639673 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 639673 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 639673 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629909028344692736
[junit4] 2> 639677 INFO (searcherExecutor-2547-thread-1-processing-n:127.0.0.1:38933_solr x:failReindexingTarget_shard1_replica_n1 c:failReindexingTarget s:shard1 r:core_node2) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SolrCore [failReindexingTarget_shard1_replica_n1] Registered new searcher Searcher@6bf51b6b[failReindexingTarget_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 639683 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexingTarget/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 639683 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexingTarget/leaders/shard1
[junit4] 2> 639685 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 639685 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 639686 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38933/solr/failReindexingTarget_shard1_replica_n1/
[junit4] 2> 639686 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 639686 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:38933/solr/failReindexingTarget_shard1_replica_n1/ has no replicas
[junit4] 2> 639686 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/failReindexingTarget/leaders/shard1/leader after winning as /collections/failReindexingTarget/leader_elect/shard1/election/72318227430899720-core_node2-n_0000000000
[junit4] 2> 639687 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38933/solr/failReindexingTarget_shard1_replica_n1/ shard1
[junit4] 2> 639788 INFO (zkCallback-2963-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
[junit4] 2> 639788 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 639792 INFO (zkCallback-2963-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
[junit4] 2> 639797 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=failReindexingTarget_shard1_replica_n1&action=CREATE&numShards=1&collection=failReindexingTarget&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1407
[junit4] 2> 639804 INFO (qtp1340283966-9366) [n:127.0.0.1:35045_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 639891 INFO (zkCallback-2961-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
[junit4] 2> 639891 INFO (zkCallback-2963-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
[junit4] 2> 639891 INFO (zkCallback-2963-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
[junit4] 2> 639891 INFO (qtp1340283966-9366) [n:127.0.0.1:35045_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&maxShardsPerNode=-1&name=failReindexingTarget&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1946
[junit4] 2> 639903 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createalias with params collections=failReindexingTarget&name=failAlias&action=CREATEALIAS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 639915 INFO (zkCallback-2963-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
[junit4] 2> 639915 INFO (OverseerCollectionConfigSetProcessor-72318227430899719-127.0.0.1:35045_solr-n_0000000000) [n:127.0.0.1:35045_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 640018 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collections=failReindexingTarget&name=failAlias&action=CREATEALIAS&wt=javabin&version=2} status=0 QTime=115
[junit4] 2> 640103 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard2 to Terms{values={core_node7=1, core_node8=1}, version=2}
[junit4] 2> 640335 INFO (qtp1340283966-9366) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard1 to Terms{values={core_node3=1, core_node5=1}, version=2}
[junit4] 2> 640358 INFO (qtp173184980-9460) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard2_replica_n6] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:35045/solr/failReindexing_shard2_replica_n4/&wt=javabin&version=2}{add=[2 (1629909028755734528), 3 (1629909028773560320), 5 (1629909028773560321), 6 (1629909028773560322), 7 (1629909028774608896), 9 (1629909028774608897), 17 (1629909028774608898), 18 (1629909028774608899), 19 (1629909028774608900), 21 (1629909028774608901), ... (97 adds)]} 0 24
[junit4] 2> 640377 ERROR (updateExecutor-2952-thread-2-processing-x:failReindexing_shard2_replica_n4 r:core_node7 null n:127.0.0.1:35045_solr c:failReindexing s:shard2) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.c.s.i.ConcurrentUpdateHttp2SolrClient Error consuming and closing http response stream.
[junit4] 2> => java.nio.channels.AsynchronousCloseException
[junit4] 2> at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316)
[junit4] 2> java.nio.channels.AsynchronousCloseException: null
[junit4] 2> at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
[junit4] 2> at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_172]
[junit4] 2> at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
[junit4] 2> at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) ~[java/:?]
[junit4] 2> at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) ~[java/:?]
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6]
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[java/:?]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_172]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_172]
[junit4] 2> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
[junit4] 2> 640377 INFO (qtp1340283966-9448) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard2_replica_n4] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1629909028755734528), 3 (1629909028773560320), 5 (1629909028773560321), 6 (1629909028773560322), 7 (1629909028774608896), 9 (1629909028774608897), 17 (1629909028774608898), 18 (1629909028774608899), 19 (1629909028774608900), 21 (1629909028774608901), ... (97 adds)]} 0 312
[junit4] 2> 640388 INFO (qtp173184980-9372) [n:127.0.0.1:38933_solr c:failReindexing s:shard1 r:core_node5 x:failReindexing_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:35045/solr/failReindexing_shard1_replica_n1/&wt=javabin&version=2}{add=[0 (1629909028745248768), 1 (1629909028755734528), 4 (1629909028755734529), 8 (1629909028755734530), 10 (1629909028755734531), 11 (1629909028755734532), 12 (1629909028755734533), 13 (1629909028755734534), 14 (1629909028756783104), 15 (1629909028757831680), ... (103 adds)]} 0 54
[junit4] 2> 640403 ERROR (updateExecutor-2952-thread-1-processing-x:failReindexing_shard1_replica_n1 r:core_node3 null n:127.0.0.1:35045_solr c:failReindexing s:shard1) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.s.i.ConcurrentUpdateHttp2SolrClient Error consuming and closing http response stream.
[junit4] 2> => java.nio.channels.AsynchronousCloseException
[junit4] 2> at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316)
[junit4] 2> java.nio.channels.AsynchronousCloseException: null
[junit4] 2> at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
[junit4] 2> at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_172]
[junit4] 2> at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
[junit4] 2> at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) ~[java/:?]
[junit4] 2> at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) ~[java/:?]
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6]
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[java/:?]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_172]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_172]
[junit4] 2> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
[junit4] 2> 640403 INFO (qtp1340283966-9366) [n:127.0.0.1:35045_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0 (1629909028745248768), 1 (1629909028755734528), 4 (1629909028755734529), 8 (1629909028755734530), 10 (1629909028755734531), 11 (1629909028755734532), 12 (1629909028755734533), 13 (1629909028755734534), 14 (1629909028756783104), 15 (1629909028757831680), ... (103 adds)]} 0 349
[junit4] 2> 640518 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1629909029230739456,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 640520 INFO (qtp1340283966-9365) [n:127.0.0.1:35045_solr c:failReindexing s:shard2 r:core_node7 x:failReindexing_shard2_replica_n4] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3a5c8a48 commitCommandVersion:1629909029230739456
[junit4] 2> 640522 INFO (qtp173184980-9371) [n:127.0.0.1:38933_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n6] o.a.s.u.Direct
[...truncated too long message...]
dSynchronizer.java:2014)
[junit4] 2> java.lang.InterruptedException: null
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_172]
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_172]
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_172]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) ~[zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
[junit4] 2> Apr 04, 2019 6:45:38 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene80): {}, docValues:{}, maxPointsInLeafNode=1435, maxMBSortInHeap=7.255942549860091, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@31fc41eb), locale=ar-SA, timezone=America/Knox_IN
[junit4] 2> NOTE: Linux 4.18.0-15-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=8,threads=2,free=281891864,total=494927872
[junit4] 2> NOTE: All tests run in this JVM: [DocumentBuilderTest, JSONWriterTest, LargeFieldTest, DistributedQueryElevationComponentTest, TestReload, TestObjectReleaseTracker, AdminHandlersProxyTest, HdfsTlogReplayBufferedWhileIndexingTest, TestWriterPerf, TestLegacyNumericUtils, SegmentsInfoRequestHandlerTest, CoreMergeIndexesAdminHandlerTest, TestSchemaNameResource, DeleteStatusTest, ScheduledMaintenanceTriggerTest, TestFacetMethods, DistributedTermsComponentTest, CheckHdfsIndexTest, TestUpdate, TestFieldCacheSortRandom, TestFastLRUCache, TriggerIntegrationTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestReplicaProperties, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ResponseLogComponentTest, IndexSizeTriggerTest, TestDistributedMap, TestCollectionsAPIViaSolrCloudCluster, TestInPlaceUpdatesStandalone, LukeRequestHandlerTest, TestUtilizeNode, SystemInfoHandlerTest, TestMultiWordSynonyms, SolrJmxReporterCloudTest, TestRestManager, TestTrackingShardHandlerFactory, HighlighterTest, TestShortCircuitedRequests, ManagedSchemaRoundRobinCloudTest, OverseerStatusTest, TestOrdValues, TestOmitPositions, OpenExchangeRatesOrgProviderTest, TestDynamicURP, OverseerCollectionConfigSetProcessorTest, TolerantUpdateProcessorTest, TestRemoteStreaming, SystemCollectionCompatTest, TestMergePolicyConfig, TestComplexPhraseQParserPlugin, TestHighFrequencyDictionaryFactory, TestSchemalessBufferedUpdates, ZkFailoverTest, FullHLLTest, NodeMutatorTest, SuggestComponentContextFilterQueryTest, SignificantTermsQParserPluginTest, CircularListTest, ReindexCollectionTest, TestZkAclsWithHadoopAuth, TestHdfsBackupRestoreCore, TestSolrCoreSnapshots, ReplaceNodeTest, TestPerFieldSimilarity, ExternalFileFieldSortTest, TestRequestForwarding, TestBM25SimilarityFactory, TestBulkSchemaConcurrent, RulesTest, TestSolr4Spatial, TestCloudJSONFacetJoinDomain, SpatialRPTFieldTypeTest, TestNumericRangeQuery32, DistributedFacetExistsSmallTest, HdfsNNFailoverTest, TestManagedSchema, TestGraphMLResponseWriter, TestHashPartitioner, TestMaxScoreQueryParser, StressHdfsTest, TestCustomStream, SolrCloudReportersTest, ChangedSchemaMergeTest, TestSolrDeletionPolicy2, ExecutePlanActionTest, V2StandaloneTest, OutputWriterTest, TestLMJelinekMercerSimilarityFactory, FullSolrCloudDistribCmdsTest, TestReplicationHandlerDiskOverFlow, CdcrUpdateLogTest, BigEndianAscendingWordSerializerTest, SolrCmdDistributorTest, DebugComponentTest, DateFieldTest, PeerSyncWithBufferUpdatesTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, BasicAuthIntegrationTest, NodeLostTriggerTest, CdcrWithNodesRestartsTest, TestRealTimeGet, ZkStateWriterTest, TestPrepRecovery, TestFieldCache, TestTrie, SolrCoreTest, TestNamedUpdateProcessors, MoreLikeThisHandlerTest, TestQuerySenderNoQuery, ClassificationUpdateProcessorTest, TestPushWriter, TestStressRecovery, DeleteNodeTest, FastVectorHighlighterTest, TestDFRSimilarityFactory, DistributedUpdateProcessorTest, BadComponentTest, TestChildDocTransformerHierarchy, TestSolrConfigHandlerConcurrent, PeerSyncWithLeaderTest, LeaderFailureAfterFreshStartTest, PeerSyncReplicationTest, UpdateParamsTest, TestSchemaVersionResource, ConfigSetsAPITest, RollingRestartTest, VMParamsZkACLAndCredentialsProvidersTest, TestFiltering, TestConfigSetsAPI, TestRetrieveFieldsOptimizer, ActionThrottleTest, TestCoreContainer, TestPolicyCloud, CoreAdminHandlerTest, ConfigureRecoveryStrategyTest, DistributedFacetSimpleRefinementLongTailTest, TestReversedWildcardFilterFactory, TestExactSharedStatsCache, TestDocumentBuilder, TestHighlightDedupGrouping, TestJoin, TestSimpleTrackingShardHandler, TestCharFilters, TokenizerChainTest, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, AliasIntegrationTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CloudExitableDirectoryReaderTest, ClusterStateUpdateTest, CollectionStateFormat2Test, ConnectionManagerTest, CreateCollectionCleanupTest, DistribCursorPagingTest, DistribJoinFromCollectionTest, DistributedQueueTest, DistributedVersionInfoTest, HttpPartitionOnCommitTest, HttpPartitionWithTlogReplicasTest, LegacyCloudClusterPropTest, MigrateRouteKeyTest, RemoteQueryErrorTest, SSLMigrationTest, SaslZkACLProviderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SaslZkACLProviderTest -Dtests.seed=FDCEB798DCEC9BBA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-SA -Dtests.timezone=America/Knox_IN -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J2 | SaslZkACLProviderTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest:
[junit4] > 1) Thread[id=27716, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
[junit4] > 2) Thread[id=27713, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
[junit4] > 3) Thread[id=27709, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[FDCEB798DCEC9BBA]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
[junit4] > at __randomizedtesting.SeedInfo.seed([FDCEB798DCEC9BBA]:0)
[junit4] Completed [493/847 (2!)] on J2 in 12.80s, 1 test, 2 errors <<< FAILURES!
[...truncated 1212 lines...]
[junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20190404_181538_5467871387610783371890.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-8.x-Linux/heapdumps/java_pid31469.hprof ...
[junit4] Heap dump file created [485036476 bytes in 3.183 secs]
[junit4] <<< JVM J0: EOF ----
[...truncated 8968 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/build.xml:633: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/build.xml:585: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid31469.hprof
Total time: 98 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2