You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/03/01 20:29:30 UTC
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build #
1454 - Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1454/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.core.TestDynamicLoading.testDynamicLoading
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([A45B71578D29D114:7C165C007AF474B4]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.core.TestDynamicLoading.testDynamicLoading(TestDynamicLoading.java:97)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 14308 lines...]
[junit4] Suite: org.apache.solr.core.TestDynamicLoading
[junit4] 2> 2277868 INFO (SUITE-TestDynamicLoading-seed#[A45B71578D29D114]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/init-core-data-001
[junit4] 2> 2277869 INFO (SUITE-TestDynamicLoading-seed#[A45B71578D29D114]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2277869 INFO (SUITE-TestDynamicLoading-seed#[A45B71578D29D114]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 2277869 INFO (SUITE-TestDynamicLoading-seed#[A45B71578D29D114]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 2277871 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2277871 INFO (Thread-6849) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2277871 INFO (Thread-6849) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2277872 ERROR (Thread-6849) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2277971 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ZkTestServer start zk server on port:34153
[junit4] 2> 2277972 INFO (zkConnectionManagerCallback-7885-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2277974 INFO (zkConnectionManagerCallback-7887-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2277976 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2277976 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2277977 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2277977 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2277978 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2277978 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2277979 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2277979 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2277979 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2277980 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2277980 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2277981 INFO (zkConnectionManagerCallback-7890-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2277982 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 2278070 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2278071 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2278071 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2278071 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2278071 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@202bba81{/,null,AVAILABLE}
[junit4] 2> 2278073 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@61eb4190{SSL,[ssl, http/1.1]}{127.0.0.1:35671}
[junit4] 2> 2278073 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server Started @2279681ms
[junit4] 2> 2278073 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/tempDir-001/control/data, hostPort=35671, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/control-001/cores, replicaType=NRT}
[junit4] 2> 2278074 ERROR (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2278074 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2278074 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2278074 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2278074 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T20:13:14.658384Z
[junit4] 2> 2278075 INFO (zkConnectionManagerCallback-7892-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2278076 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2278076 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/control-001/solr.xml
[junit4] 2> 2278078 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2278078 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2278079 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2278081 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34153/solr
[junit4] 2> 2278082 INFO (zkConnectionManagerCallback-7896-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2278083 INFO (zkConnectionManagerCallback-7898-thread-1-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2278118 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2278118 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35671_
[junit4] 2> 2278118 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.c.Overseer Overseer (id=72062365160308741-127.0.0.1:35671_-n_0000000000) starting
[junit4] 2> 2278122 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35671_
[junit4] 2> 2278122 INFO (zkCallback-7897-thread-1-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2278146 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2278152 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2278152 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2278153 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:35671_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/control-001/cores
[junit4] 2> 2278172 INFO (zkConnectionManagerCallback-7904-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2278173 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2278173 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34153/solr ready
[junit4] 2> 2278185 INFO (qtp1576994085-28870) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35671_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2278187 INFO (OverseerThreadFactory-9216-thread-1-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 2278293 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2278293 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2278396 INFO (zkCallback-7897-thread-1-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2279301 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2279309 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 2279361 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2279368 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 2279368 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2279368 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2279368 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 2279370 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@272cb997
[junit4] 2> 2279371 WARN (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2279398 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2279398 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2279399 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2279399 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2279400 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2279400 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@39b32e8f[control_collection_shard1_replica_n1] main]
[junit4] 2> 2279401 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2279401 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2279402 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2279402 INFO (searcherExecutor-9219-thread-1-processing-n:127.0.0.1:35671_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@39b32e8f[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2279402 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593767568066215936
[junit4] 2> 2279406 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2279407 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2279407 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35671/control_collection_shard1_replica_n1/
[junit4] 2> 2279407 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2279407 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:35671/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 2279407 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2279408 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35671/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 2279509 INFO (zkCallback-7897-thread-2-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2279559 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2279565 INFO (qtp1576994085-28875) [n:127.0.0.1:35671_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1272
[junit4] 2> 2279567 INFO (qtp1576994085-28870) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2279666 INFO (zkCallback-7897-thread-2-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2280188 INFO (OverseerCollectionConfigSetProcessor-72062365160308741-127.0.0.1:35671_-n_0000000000) [n:127.0.0.1:35671_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2280568 INFO (qtp1576994085-28870) [n:127.0.0.1:35671_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35671_&wt=javabin&version=2} status=0 QTime=2382
[junit4] 2> 2280571 INFO (zkConnectionManagerCallback-7908-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2280571 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2280572 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34153/solr ready
[junit4] 2> 2280572 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2280573 INFO (qtp1576994085-28874) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2280574 INFO (OverseerThreadFactory-9216-thread-2-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 2280575 WARN (OverseerThreadFactory-9216-thread-2-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 2280777 INFO (qtp1576994085-28874) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2280777 INFO (qtp1576994085-28874) [n:127.0.0.1:35671_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=203
[junit4] 2> 2280916 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-1-001 of type NRT
[junit4] 2> 2280918 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2280918 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2280918 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2280918 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2280919 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d39b737{/,null,AVAILABLE}
[junit4] 2> 2280919 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7012cd4d{SSL,[ssl, http/1.1]}{127.0.0.1:43671}
[junit4] 2> 2280919 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server Started @2282527ms
[junit4] 2> 2280919 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/tempDir-001/jetty1, hostPort=43671, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-1-001/cores}
[junit4] 2> 2280919 ERROR (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2280920 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2280920 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2280920 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2280920 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T20:13:17.504155Z
[junit4] 2> 2280921 INFO (zkConnectionManagerCallback-7910-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2280921 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2280921 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-1-001/solr.xml
[junit4] 2> 2280923 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2280923 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2280923 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2280925 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34153/solr
[junit4] 2> 2280926 INFO (zkConnectionManagerCallback-7914-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2280927 INFO (zkConnectionManagerCallback-7916-thread-1-processing-n:127.0.0.1:43671_) [n:127.0.0.1:43671_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2280930 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:43671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2280931 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:43671_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2280932 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:43671_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43671_
[junit4] 2> 2280932 INFO (zkCallback-7907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2280932 INFO (zkCallback-7897-thread-2-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2280934 INFO (zkCallback-7915-thread-1-processing-n:127.0.0.1:43671_) [n:127.0.0.1:43671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2280989 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:43671_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2281002 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:43671_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2281003 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:43671_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2281005 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:43671_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-1-001/cores
[junit4] 2> 2281033 INFO (qtp1576994085-28870) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:43671_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2281034 INFO (OverseerCollectionConfigSetProcessor-72062365160308741-127.0.0.1:35671_-n_0000000000) [n:127.0.0.1:35671_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2281034 INFO (OverseerThreadFactory-9216-thread-3-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:43671_ for creating new replica
[junit4] 2> 2281044 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2281045 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2282054 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2282064 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 2282134 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2282145 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 2282146 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2282146 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2282146 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 2282149 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@8e56e4b
[junit4] 2> 2282150 WARN (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2282201 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2282201 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2282203 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2282203 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2282204 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2282204 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@7ac249cf[collection1_shard2_replica_n41] main]
[junit4] 2> 2282205 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2282205 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2282206 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2282207 INFO (searcherExecutor-9230-thread-1-processing-n:127.0.0.1:43671_ x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@7ac249cf[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2282207 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593767571007471616
[junit4] 2> 2282211 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2282211 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2282211 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:43671/collection1_shard2_replica_n41/
[junit4] 2> 2282211 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2282211 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy https://127.0.0.1:43671/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 2282211 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2282213 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:43671/collection1_shard2_replica_n41/ shard2
[junit4] 2> 2282364 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2282552 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1507
[junit4] 2> 2282553 INFO (qtp1576994085-28870) [n:127.0.0.1:35671_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:43671_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1520
[junit4] 2> 2282688 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-2-001 of type NRT
[junit4] 2> 2282689 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2282697 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2282697 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2282698 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2282698 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f2087fa{/,null,AVAILABLE}
[junit4] 2> 2282698 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@73fdb0af{SSL,[ssl, http/1.1]}{127.0.0.1:46553}
[junit4] 2> 2282698 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server Started @2284306ms
[junit4] 2> 2282698 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/tempDir-001/jetty2, hostPort=46553, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-2-001/cores, replicaType=NRT}
[junit4] 2> 2282699 ERROR (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2282699 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2282699 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2282699 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2282699 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T20:13:19.283449Z
[junit4] 2> 2282702 INFO (zkConnectionManagerCallback-7920-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2282703 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2282703 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-2-001/solr.xml
[junit4] 2> 2282705 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2282705 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2282706 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2282710 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34153/solr
[junit4] 2> 2282711 INFO (zkConnectionManagerCallback-7924-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2282717 INFO (zkConnectionManagerCallback-7926-thread-1-processing-n:127.0.0.1:46553_) [n:127.0.0.1:46553_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2282720 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:46553_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2282721 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:46553_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2282722 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:46553_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46553_
[junit4] 2> 2282723 INFO (zkCallback-7915-thread-1-processing-n:127.0.0.1:43671_) [n:127.0.0.1:43671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2282723 INFO (zkCallback-7907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2282723 INFO (zkCallback-7897-thread-1-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2282726 INFO (zkCallback-7925-thread-1-processing-n:127.0.0.1:46553_) [n:127.0.0.1:46553_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2282764 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:46553_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2282771 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:46553_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2282771 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:46553_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2282772 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:46553_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-2-001/cores
[junit4] 2> 2282794 INFO (qtp1576994085-28874) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46553_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2282795 INFO (OverseerCollectionConfigSetProcessor-72062365160308741-127.0.0.1:35671_-n_0000000000) [n:127.0.0.1:35671_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2282796 INFO (OverseerThreadFactory-9216-thread-4-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:46553_ for creating new replica
[junit4] 2> 2282806 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2282806 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2283878 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2283884 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 2283934 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2283942 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 2283942 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2283942 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2283942 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 2283944 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@720c38a6
[junit4] 2> 2283949 WARN (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2283975 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2283975 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2283976 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2283976 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2283977 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2283977 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@38d54110[collection1_shard1_replica_n43] main]
[junit4] 2> 2283978 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2283978 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2283978 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2283979 INFO (searcherExecutor-9241-thread-1-processing-n:127.0.0.1:46553_ x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@38d54110[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2283979 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593767572865548288
[junit4] 2> 2283983 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2283983 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2283983 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:46553/collection1_shard1_replica_n43/
[junit4] 2> 2283983 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2283983 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy https://127.0.0.1:46553/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 2283983 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2283984 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:46553/collection1_shard1_replica_n43/ shard1
[junit4] 2> 2284135 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2284136 INFO (qtp1720824966-28958) [n:127.0.0.1:46553_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1330
[junit4] 2> 2284137 INFO (qtp1576994085-28874) [n:127.0.0.1:35671_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46553_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1343
[junit4] 2> 2284217 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-3-001 of type NRT
[junit4] 2> 2284218 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2284218 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2284218 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2284218 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f371d0b{/,null,AVAILABLE}
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@336c1c3f{SSL,[ssl, http/1.1]}{127.0.0.1:45531}
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server Started @2285826ms
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/tempDir-001/jetty3, hostPort=45531, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-3-001/cores}
[junit4] 2> 2284219 ERROR (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2284219 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T20:13:20.803896Z
[junit4] 2> 2284220 INFO (zkConnectionManagerCallback-7930-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2284221 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2284221 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-3-001/solr.xml
[junit4] 2> 2284222 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2284222 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2284223 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2284224 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34153/solr
[junit4] 2> 2284225 INFO (zkConnectionManagerCallback-7934-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2284226 INFO (zkConnectionManagerCallback-7936-thread-1-processing-n:127.0.0.1:45531_) [n:127.0.0.1:45531_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2284228 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:45531_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2284229 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:45531_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2284229 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:45531_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45531_
[junit4] 2> 2284230 INFO (zkCallback-7925-thread-1-processing-n:127.0.0.1:46553_) [n:127.0.0.1:46553_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2284230 INFO (zkCallback-7915-thread-1-processing-n:127.0.0.1:43671_) [n:127.0.0.1:43671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2284230 INFO (zkCallback-7907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2284230 INFO (zkCallback-7935-thread-1-processing-n:127.0.0.1:45531_) [n:127.0.0.1:45531_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2284230 INFO (zkCallback-7897-thread-2-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2284253 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:45531_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2284260 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:45531_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2284260 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:45531_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2284261 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:45531_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-3-001/cores
[junit4] 2> 2284286 INFO (qtp1576994085-28870) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:45531_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2284289 INFO (OverseerCollectionConfigSetProcessor-72062365160308741-127.0.0.1:35671_-n_0000000000) [n:127.0.0.1:35671_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2284289 INFO (OverseerThreadFactory-9216-thread-5-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:45531_ for creating new replica
[junit4] 2> 2284297 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2284297 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2285306 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2285314 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
[junit4] 2> 2285370 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2285379 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
[junit4] 2> 2285379 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2285379 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2285379 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
[junit4] 2> 2285382 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@11407153
[junit4] 2> 2285383 WARN (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2285455 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2285455 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2285455 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2285456 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2285456 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2285457 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@56b3fdf1[collection1_shard2_replica_n45] main]
[junit4] 2> 2285458 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2285458 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2285458 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2285459 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593767574417440768
[junit4] 2> 2285459 INFO (searcherExecutor-9252-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [collection1_shard2_replica_n45] Registered new searcher Searcher@56b3fdf1[collection1_shard2_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2285462 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n45
[junit4] 2> 2285462 INFO (updateExecutor-7931-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:45531_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 2285462 INFO (recoveryExecutor-7932-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:45531_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 2285462 INFO (recoveryExecutor-7932-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:45531_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 2285462 INFO (qtp352159118-28989) [n:127.0.0.1:45531_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1165
[junit4] 2> 2285463 INFO (qtp1576994085-28870) [n:127.0.0.1:35671_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:45531_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1177
[junit4] 2> 2285465 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2285465 INFO (qtp886893838-28927) [n:127.0.0.1:43671_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2285466 INFO (recoveryExecutor-7932-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:45531_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n45]
[junit4] 2> 2285466 INFO (recoveryExecutor-7932-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:45531_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2285466 INFO (recoveryExecutor-7932-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:45531_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n45] as recovering, leader is [https://127.0.0.1:43671/collection1_shard2_replica_n41/] and I am [https://127.0.0.1:45531/collection1_shard2_replica_n45/]
[junit4] 2> 2285470 INFO (recoveryExecutor-7932-thread-1-processing-n:127.0.0.1:45531_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:45531_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:43671]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:45531_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 2285472 INFO (qtp886893838-28921) [n:127.0.0.1:43671_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 2285472 INFO (qtp886893838-28921) [n:127.0.0.1:43671_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:45531_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"https://127.0.0.1:45531","node_name":"127.0.0.1:45531_","state":"down","type":"NRT"}
[junit4] 2> 2285541 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-4-001 of type NRT
[junit4] 2> 2285542 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2285542 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2285542 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2285542 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2285542 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@241a1b9d{/,null,AVAILABLE}
[junit4] 2> 2285543 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@b0d3d04{SSL,[ssl, http/1.1]}{127.0.0.1:40967}
[junit4] 2> 2285543 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.e.j.s.Server Started @2287150ms
[junit4] 2> 2285543 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/tempDir-001/jetty4, hostPort=40967, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-4-001/cores}
[junit4] 2> 2285543 ERROR (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2285543 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2285543 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2285543 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2285543 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T20:13:22.127753Z
[junit4] 2> 2285544 INFO (zkConnectionManagerCallback-7941-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2285545 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2285545 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-4-001/solr.xml
[junit4] 2> 2285546 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2285546 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2285547 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2285548 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34153/solr
[junit4] 2> 2285549 INFO (zkConnectionManagerCallback-7945-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2285551 INFO (zkConnectionManagerCallback-7947-thread-1-processing-n:127.0.0.1:40967_) [n:127.0.0.1:40967_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2285553 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:40967_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2285554 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:40967_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2285555 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:40967_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40967_
[junit4] 2> 2285556 INFO (zkCallback-7925-thread-1-processing-n:127.0.0.1:46553_) [n:127.0.0.1:46553_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2285556 INFO (zkCallback-7897-thread-2-processing-n:127.0.0.1:35671_) [n:127.0.0.1:35671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2285556 INFO (zkCallback-7935-thread-1-processing-n:127.0.0.1:45531_) [n:127.0.0.1:45531_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2285556 INFO (zkCallback-7907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2285556 INFO (zkCallback-7915-thread-1-processing-n:127.0.0.1:43671_) [n:127.0.0.1:43671_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2285556 INFO (zkCallback-7946-thread-1-processing-n:127.0.0.1:40967_) [n:127.0.0.1:40967_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2285581 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:40967_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2285588 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:40967_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2285588 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:40967_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@679e757f
[junit4] 2> 2285589 INFO (TEST-TestDynamicLoading.testDynamicLoading-seed#[A45B71578D29D114]) [n:127.0.0.1:40967_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001/shard-4-001/cores
[junit4] 2> 2285622 INFO (qtp1576994085-28874) [n:127.0.0.1:35671_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addrepli
[...truncated too long message...]
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2> 2 /solr/collections/.system/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDynamicLoading -Dtests.method=testDynamicLoading -Dtests.seed=A45B71578D29D114 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=br -Dtests.timezone=Asia/Chongqing -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 21.5s J0 | TestDynamicLoading.testDynamicLoading <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([A45B71578D29D114:7C165C007AF474B4]:0)
[junit4] > at org.apache.solr.core.TestDynamicLoading.testDynamicLoading(TestDynamicLoading.java:97)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading_A45B71578D29D114-001
[junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=15523, maxDocsPerChunk=920, blockSize=323), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=15523, blockSize=323)), sim=RandomSimilarity(queryNorm=false): {}, locale=br, timezone=Asia/Chongqing
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=232886560,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestIndexingPerformance, RequestHandlersTest, ChangedSchemaMergeTest, DistributedFacetPivotSmallAdvancedTest, MissingSegmentRecoveryTest, SolrJmxReporterCloudTest, ResponseBuilderTest, OutOfBoxZkACLAndCredentialsProvidersTest, TolerantUpdateProcessorTest, HdfsAutoAddReplicasIntegrationTest, SegmentsInfoRequestHandlerTest, TestCustomStream, TestPhraseSuggestions, TestClusterStateProvider, HdfsSyncSliceTest, SolrCoreCheckLockOnStartupTest, OverseerModifyCollectionTest, OverseerTaskQueueTest, ParsingFieldUpdateProcessorsTest, TestPointFields, TestSolrDeletionPolicy1, OpenExchangeRatesOrgProviderTest, TestManagedResourceStorage, SolrPluginUtilsTest, TestStressLucene, SpatialRPTFieldTypeTest, TemplateUpdateProcessorTest, TestSolrCloudWithDelegationTokens, SolrIndexConfigTest, SpellCheckCollatorTest, TestSolrCoreParser, TestSolrQueryResponse, DistributedTermsComponentTest, TestFieldCacheWithThreads, TestWordDelimiterFilterFactory, TestConfigReload, TestQuerySenderNoQuery, ChaosMonkeySafeLeaderWithPullReplicasTest, TermVectorComponentDistributedTest, ImplicitSnitchTest, TestCustomDocTransformer, TestDocTermOrds, AssignTest, TestJoin, TestManagedSchema, ExitableDirectoryReaderTest, DirectUpdateHandlerTest, SolrCloudReportersTest, MetricsHandlerTest, TestDocSet, SolrMetricsIntegrationTest, NodeAddedTriggerTest, CollectionsAPIAsyncDistributedZkTest, CreateCollectionCleanupTest, TestOmitPositions, CustomCollectionTest, SolrRequestParserTest, LeaderElectionContextKeyTest, TestStressUserVersions, TestPHPSerializedResponseWriter, TestRandomFaceting, SubstringBytesRefFilterTest, CheckHdfsIndexTest, BufferStoreTest, ConcurrentCreateRoutedAliasTest, TestZkAclsWithHadoopAuth, SolrIndexSplitterTest, CdcrBidirectionalTest, FullHLLTest, ConfigureRecoveryStrategyTest, TestSimDistributedQueue, TestCloudJSONFacetJoinDomain, CursorPagingTest, NumberUtilsTest, TestConfigSetProperties, OutputWriterTest, FieldAnalysisRequestHandlerTest, SSLMigrationTest, CoreAdminRequestStatusTest, TestExecutePlanAction, TestRawResponseWriter, BigEndianAscendingWordSerializerTest, TestCollationField, ShardRoutingTest, ShufflingReplicaListTransformerTest, MoveReplicaTest, TestFieldCollectionResource, DistributedVersionInfoTest, BasicAuthStandaloneTest, RAMDirectoryFactoryTest, SolrCLIZkUtilsTest, TestWriterPerf, TestTlogReplica, TestStreamBody, LeaderInitiatedRecoveryOnShardRestartTest, TestGroupingSearch, TestEmbeddedSolrServerSchemaAPI, TestHttpShardHandlerFactory, HdfsChaosMonkeyNothingIsSafeTest, MBeansHandlerTest, SuggestComponentTest, TestLeaderElectionWithEmptyReplica, TestHighFrequencyDictionaryFactory, TestLockTree, XmlUpdateRequestHandlerTest, TestStressCloudBlindAtomicUpdates, TestRequestForwarding, AssignBackwardCompatibilityTest, SparseHLLTest, HdfsUnloadDistributedZkTest, TestLegacyNumericRangeQueryBuilder, TestNumericTerms64, TestConfig, ReplicationFactorTest, FacetPivotSmallTest, TestCustomSort, TestGraphMLResponseWriter, BinaryUpdateRequestHandlerTest, TestLMDirichletSimilarityFactory, TestComponentsName, TestSolrCloudSnapshots, TestReplicationHandlerBackup, DistribDocExpirationUpdateProcessorTest, BasicDistributedZkTest, TestPseudoReturnFields, TestMultiWordSynonyms, SyncSliceTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, LeaderElectionTest, ZkSolrClientTest, ZkCLITest, TestDistributedSearch, ZkControllerTest, TestCoreContainer, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, TestIndexSearcher, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, DocValuesTest, SuggesterTSTTest, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestAtomicUpdateErrorCases, QueryEqualityTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, SolrInfoBeanTest, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TermsComponentTest, PathHierarchyTokenizerFactoryTest, RequiredFieldsTest, LoggingHandlerTest, IndexSchemaTest, ReturnFieldsTest, TestCSVResponseWriter, TestAnalyzedSuggestions, PingRequestHandlerTest, TestLFUCache, PrimUtilsTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, TestRTGBase, TestCrossCoreJoin, TestDistributedMissingSort, TestHighlightDedupGrouping, TestLuceneIndexBackCompat, AsyncCallRequestStatusResponseTest, CloudExitableDirectoryReaderTest, ConnectionManagerTest, CreateRoutedAliasTest, DeleteLastCustomShardedReplicaTest, ForceLeaderTest, OverseerStatusTest, PeerSyncReplicationTest, RemoteQueryErrorTest, RestartWhileUpdatingTest, SharedFSAutoReplicaFailoverTest, SolrCloudExampleTest, TestClusterProperties, TestConfigSetsAPIExclusivity, TestCryptoKeys, TestLeaderInitiatedRecoveryThread, TestPrepRecovery, TestPullReplica, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation, TestStressLiveNodes, TestUtilizeNode, VMParamsZkACLAndCredentialsProvidersTest, ConcurrentDeleteAndCreateCollectionTest, SimpleCollectionCreateDeleteTest, TestHdfsCloudBackupRestore, AutoScalingHandlerTest, ComputePlanActionTest, TestDistribStateManager, TestGenericDistributedQueue, TestNodeAddedTrigger, TestPolicyCloud, TestTriggerIntegration, CdcrReplicationHandlerTest, HDFSCollectionsAPITest, HdfsWriteToMultipleCollectionsTest, StressHdfsTest, TestBackupRepositoryFactory, TestConfigSetImmutable, TestConfigSets, TestDirectoryFactory, TestDynamicLoading]
[junit4] Completed [630/777 (1!)] on J0 in 21.49s, 1 test, 1 failure <<< FAILURES!
[...truncated 41748 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1454/consoleText
[repro] Revision: 2732a373c2fc381625ceb253836f034f61adb7ad
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=TestDynamicLoading -Dtests.method=testDynamicLoading -Dtests.seed=A45B71578D29D114 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=br -Dtests.timezone=Asia/Chongqing -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestDynamicLoading
[repro] ant compile-test
[...truncated 3315 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestDynamicLoading" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=A45B71578D29D114 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=br -Dtests.timezone=Asia/Chongqing -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 76 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.core.TestDynamicLoading
[repro] Exiting with code 0
[...truncated 40 lines...]
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build #
1456 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1456/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([C580C5964A2A5011:3CCD5639765F1D9B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:283)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12908 lines...]
[junit4] Suite: org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4] 2> 691111 INFO (SUITE-ShardSplitTest-seed#[C580C5964A2A5011]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/init-core-data-001
[junit4] 2> 691111 WARN (SUITE-ShardSplitTest-seed#[C580C5964A2A5011]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 691111 INFO (SUITE-ShardSplitTest-seed#[C580C5964A2A5011]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 691112 INFO (SUITE-ShardSplitTest-seed#[C580C5964A2A5011]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
[junit4] 2> 691112 INFO (SUITE-ShardSplitTest-seed#[C580C5964A2A5011]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] IGNOR/A 0.00s J2 | ShardSplitTest.test
[junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
[junit4] 2> 691114 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 691117 INFO (Thread-2250) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 691117 INFO (Thread-2250) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 691130 ERROR (Thread-2250) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 691217 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ZkTestServer start zk server on port:40523
[junit4] 2> 691223 INFO (zkConnectionManagerCallback-550-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 691230 INFO (zkConnectionManagerCallback-552-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 691233 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 691234 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 691235 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 691235 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 691236 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 691237 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 691238 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 691238 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 691239 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 691240 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 691241 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 691242 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 691334 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 691336 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 691336 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 691336 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 691336 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36e9b6bd{/,null,AVAILABLE}
[junit4] 2> 691338 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@17892be3{HTTP/1.1,[http/1.1]}{127.0.0.1:41415}
[junit4] 2> 691338 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server Started @693249ms
[junit4] 2> 691338 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/tempDir-001/control/data, hostPort=41415, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/control-001/cores, replicaType=NRT}
[junit4] 2> 691339 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 691339 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 691339 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 691339 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 691339 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T03:08:40.863299Z
[junit4] 2> 691357 INFO (zkConnectionManagerCallback-554-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 691359 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 691359 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/control-001/solr.xml
[junit4] 2> 691361 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 691361 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 691362 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 691364 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40523/solr
[junit4] 2> 691369 INFO (zkConnectionManagerCallback-558-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 691373 INFO (zkConnectionManagerCallback-560-thread-1-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 691413 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 691413 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41415_
[junit4] 2> 691414 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.c.Overseer Overseer (id=72063998723358724-127.0.0.1:41415_-n_0000000000) starting
[junit4] 2> 691425 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41415_
[junit4] 2> 691426 INFO (OverseerStateUpdate-72063998723358724-127.0.0.1:41415_-n_0000000000) [n:127.0.0.1:41415_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 691459 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 691468 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 691468 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 691469 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41415_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/control-001/cores
[junit4] 2> 691502 INFO (zkConnectionManagerCallback-566-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 691503 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 691503 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40523/solr ready
[junit4] 2> 691511 INFO (qtp628301842-5536) [n:127.0.0.1:41415_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41415_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 691525 INFO (OverseerThreadFactory-1154-thread-1-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 691648 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 691649 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 691751 INFO (zkCallback-559-thread-1-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 692683 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 692695 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 692816 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 692864 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 692865 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 692867 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 692867 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 692870 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=928798852, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 692894 WARN (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 692950 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 692950 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 692966 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 692966 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 692968 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=91.8154296875, floorSegmentMB=1.5341796875, forceMergeDeletesPctAllowed=11.20791882715368, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 692969 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2c48c9af[control_collection_shard1_replica_n1] main]
[junit4] 2> 692973 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 692974 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 692974 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 692976 INFO (searcherExecutor-1157-thread-1-processing-n:127.0.0.1:41415_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@2c48c9af[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 692977 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593793705411608576
[junit4] 2> 692987 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 692988 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 692988 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41415/control_collection_shard1_replica_n1/
[junit4] 2> 692988 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 692988 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:41415/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 692988 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 692990 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41415/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 693091 INFO (zkCallback-559-thread-1-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 693141 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 693149 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1501
[junit4] 2> 693152 INFO (qtp628301842-5536) [n:127.0.0.1:41415_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 693246 INFO (zkCallback-559-thread-2-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 693535 INFO (OverseerCollectionConfigSetProcessor-72063998723358724-127.0.0.1:41415_-n_0000000000) [n:127.0.0.1:41415_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 694152 INFO (qtp628301842-5536) [n:127.0.0.1:41415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41415_&wt=javabin&version=2} status=0 QTime=2641
[junit4] 2> 694158 INFO (zkConnectionManagerCallback-570-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 694158 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 694159 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40523/solr ready
[junit4] 2> 694159 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 694160 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 694167 INFO (OverseerThreadFactory-1154-thread-2-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 694167 WARN (OverseerThreadFactory-1154-thread-2-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 694372 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 694373 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=212
[junit4] 2> 694452 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-1-001 of type TLOG
[junit4] 2> 694453 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 694453 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 694453 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 694453 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 694454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28c222dd{/,null,AVAILABLE}
[junit4] 2> 694454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@66c20c5d{HTTP/1.1,[http/1.1]}{127.0.0.1:43617}
[junit4] 2> 694454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server Started @696364ms
[junit4] 2> 694454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/tempDir-001/jetty1, hostPort=43617, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-1-001/cores, replicaType=TLOG}
[junit4] 2> 694455 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 694455 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 694455 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 694455 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 694455 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T03:08:43.979603Z
[junit4] 2> 694456 INFO (zkConnectionManagerCallback-572-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 694458 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 694458 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-1-001/solr.xml
[junit4] 2> 694459 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 694459 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 694460 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 694463 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40523/solr
[junit4] 2> 694464 INFO (zkConnectionManagerCallback-576-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 694467 INFO (zkConnectionManagerCallback-578-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 694474 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 694475 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:43617_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 694476 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:43617_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43617_
[junit4] 2> 694477 INFO (zkCallback-559-thread-2-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 694478 INFO (zkCallback-569-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 694478 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 694500 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:43617_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 694507 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:43617_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 694507 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:43617_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 694508 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:43617_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-1-001/cores
[junit4] 2> 694532 INFO (qtp628301842-5571) [n:127.0.0.1:41415_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:43617_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 694534 INFO (OverseerCollectionConfigSetProcessor-72063998723358724-127.0.0.1:41415_-n_0000000000) [n:127.0.0.1:41415_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 694535 INFO (OverseerThreadFactory-1154-thread-3-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:43617_ for creating new replica
[junit4] 2> 694537 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 694537 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 694640 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 695555 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 695568 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 695659 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 695672 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 695672 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 695673 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 695673 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 695676 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=928798852, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 695699 WARN (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 695748 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 695748 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 695749 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 695749 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 695750 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=91.8154296875, floorSegmentMB=1.5341796875, forceMergeDeletesPctAllowed=11.20791882715368, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 695751 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@10be4d5b[collection1_shard2_replica_t41] main]
[junit4] 2> 695752 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 695752 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 695753 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 695755 INFO (searcherExecutor-1168-thread-1-processing-n:127.0.0.1:43617_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@10be4d5b[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 695755 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593793708324552704
[junit4] 2> 695766 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 695766 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 695766 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43617/collection1_shard2_replica_t41/
[junit4] 2> 695766 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 695766 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:43617/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 695766 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 695766 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 695768 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43617/collection1_shard2_replica_t41/ shard2
[junit4] 2> 695869 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 695919 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 695921 INFO (qtp498157557-5587) [n:127.0.0.1:43617_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1383
[junit4] 2> 695922 INFO (qtp628301842-5571) [n:127.0.0.1:41415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:43617_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1389
[junit4] 2> 695990 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-2-001 of type TLOG
[junit4] 2> 695992 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 695998 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 695998 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 695998 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 695999 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@232b6d04{/,null,AVAILABLE}
[junit4] 2> 695999 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@66134bda{HTTP/1.1,[http/1.1]}{127.0.0.1:41967}
[junit4] 2> 695999 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server Started @697910ms
[junit4] 2> 695999 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/tempDir-001/jetty2, hostPort=41967, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-2-001/cores, replicaType=TLOG}
[junit4] 2> 696000 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 696000 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 696000 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 696000 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 696000 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T03:08:45.524652Z
[junit4] 2> 696009 INFO (zkConnectionManagerCallback-582-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 696009 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 696010 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-2-001/solr.xml
[junit4] 2> 696012 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 696012 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 696012 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 696014 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40523/solr
[junit4] 2> 696021 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 696029 INFO (zkConnectionManagerCallback-586-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 696038 INFO (zkConnectionManagerCallback-588-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 696056 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 696057 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41967_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 696058 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41967_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41967_
[junit4] 2> 696059 INFO (zkCallback-569-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 696059 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 696059 INFO (zkCallback-559-thread-2-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 696076 INFO (zkCallback-587-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 696104 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41967_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 696115 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41967_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 696115 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41967_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 696116 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41967_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-2-001/cores
[junit4] 2> 696157 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41967_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 696160 INFO (OverseerCollectionConfigSetProcessor-72063998723358724-127.0.0.1:41415_-n_0000000000) [n:127.0.0.1:41415_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 696161 INFO (OverseerThreadFactory-1154-thread-4-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:41967_ for creating new replica
[junit4] 2> 696166 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 696166 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 696270 INFO (zkCallback-587-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 696271 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 697182 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 697194 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 697277 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 697291 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 697291 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 697291 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 697291 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 697293 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=928798852, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 697315 WARN (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 697347 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 697347 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 697348 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 697348 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 697349 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=91.8154296875, floorSegmentMB=1.5341796875, forceMergeDeletesPctAllowed=11.20791882715368, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 697349 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@7d42acba[collection1_shard1_replica_t43] main]
[junit4] 2> 697350 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 697350 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 697351 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 697351 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593793709998080000
[junit4] 2> 697352 INFO (searcherExecutor-1179-thread-1-processing-n:127.0.0.1:41967_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@7d42acba[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 697355 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 697355 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 697355 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41967/collection1_shard1_replica_t43/
[junit4] 2> 697355 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 697355 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:41967/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 697355 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 697355 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 697356 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41967/collection1_shard1_replica_t43/ shard1
[junit4] 2> 697457 INFO (zkCallback-587-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 697457 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 697507 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 697508 INFO (qtp1966115507-5619) [n:127.0.0.1:41967_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1342
[junit4] 2> 697510 INFO (qtp628301842-5542) [n:127.0.0.1:41415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:41967_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1353
[junit4] 2> 697610 INFO (zkCallback-587-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 697610 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 697628 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-3-001 of type TLOG
[junit4] 2> 697629 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 697633 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 697633 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 697633 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 697633 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4234946d{/,null,AVAILABLE}
[junit4] 2> 697634 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@41f8f6a1{HTTP/1.1,[http/1.1]}{127.0.0.1:41783}
[junit4] 2> 697634 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.e.j.s.Server Started @699544ms
[junit4] 2> 697634 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/tempDir-001/jetty3, hostPort=41783, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-3-001/cores, replicaType=TLOG}
[junit4] 2> 697634 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 697635 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 697635 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 697635 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 697635 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T03:08:47.159202Z
[junit4] 2> 697636 INFO (zkConnectionManagerCallback-592-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 697637 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 697637 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-3-001/solr.xml
[junit4] 2> 697639 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 697639 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 697639 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 697651 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40523/solr
[junit4] 2> 697659 INFO (zkConnectionManagerCallback-596-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 697665 INFO (zkConnectionManagerCallback-598-thread-1-processing-n:127.0.0.1:41783_) [n:127.0.0.1:41783_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 697669 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41783_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 697671 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41783_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 697672 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41783_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41783_
[junit4] 2> 697673 INFO (zkCallback-569-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 697673 INFO (zkCallback-587-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 697673 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 697673 INFO (zkCallback-559-thread-2-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 697674 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:41783_) [n:127.0.0.1:41783_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 697720 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41783_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 697731 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41783_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 697731 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41783_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 697733 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[C580C5964A2A5011]) [n:127.0.0.1:41783_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-3-001/cores
[junit4] 2> 697774 INFO (qtp628301842-5571) [n:127.0.0.1:41415_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41783_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 697790 INFO (OverseerCollectionConfigSetProcessor-72063998723358724-127.0.0.1:41415_-n_0000000000) [n:127.0.0.1:41415_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 697793 INFO (OverseerThreadFactory-1154-thread-5-processing-n:127.0.0.1:41415_) [n:127.0.0.1:41415_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:41783_ for creating new replica
[junit4] 2> 697797 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 697797 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 697907 INFO (zkCallback-587-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 697907 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 697908 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:41783_) [n:127.0.0.1:41783_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 698813 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 698823 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 698937 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 698956 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 698956 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@662744bb
[junit4] 2> 698956 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 698956 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 699013 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=928798852, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 699035 WARN (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 699095 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 699096 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 699097 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 699097 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 699099 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=91.8154296875, floorSegmentMB=1.5341796875, forceMergeDeletesPctAllowed=11.20791882715368, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 699099 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@2618c85a[collection1_shard2_replica_t45] main]
[junit4] 2> 699102 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 699102 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 699103 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 699103 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593793711835185152
[junit4] 2> 699106 INFO (searcherExecutor-1190-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@2618c85a[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 699120 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
[junit4] 2> 699126 INFO (updateExecutor-593-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 699126 INFO (recoveryExecutor-594-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 699126 INFO (recoveryExecutor-594-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 699126 INFO (recoveryExecutor-594-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
[junit4] 2> 699129 INFO (qtp498157557-5593) [n:127.0.0.1:43617_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.c.S.Request [collection1_shard2_replica_t41] webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 699129 INFO (qtp498157557-5593) [n:127.0.0.1:43617_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.c.S.Request [collection1_shard2_replica_t41] webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 699130 INFO (recoveryExecutor-594-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
[junit4] 2> 699130 INFO (recoveryExecutor-594-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 699130 INFO (recoveryExecutor-594-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:43617/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:41783/collection1_shard2_replica_t45/]
[junit4] 2> 699130 INFO (qtp1554959688-5650) [n:127.0.0.1:41783_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1333
[junit4] 2> 699135 INFO (qtp628301842-5571) [n:127.0.0.1:41415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:41783_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1361
[junit4] 2> 699142 INFO (recoveryExecutor-594-thread-1-processing-n:127.0.0.1:41783_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41783_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:43617]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:41783_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 699142 INFO (qtp498157557-5593) [n:127.0.0.1:43617_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 699143 INFO (qtp498157557-5593) [n:127.0.0.1:43617_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:41783_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:41783","node_name":"127.0.0.1:41783_","state":"down","type":"TLOG"}
[junit4] 2> 699235 INFO (zkCallback-587-thread-1-processing-n:127.0.0.1:41967_) [n:127.0.0.1:41967_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 699235 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:41783_) [n:127.0.0.1:41783_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 699235 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:43617_) [n:127.0.0.1:43617_ ] o.a.s.c.c.ZkStateReader A cluster s
[...truncated too long message...]
[junit4] 2> 916787 INFO (qtp107084430-6922) [n:127.0.0.1:35743_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:41119_&core=shardSplitWithRule_shard1_1_replica_n6&coreNodeName=core_node9&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=3001
[junit4] 2> 916899 ERROR (qtp107084430-7097) [n:127.0.0.1:35743_ ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Solr is shutting down
[junit4] 2> at org.apache.solr.handler.admin.PrepRecoveryOp.execute(PrepRecoveryOp.java:178)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:384)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> 916900 INFO (qtp107084430-7097) [n:127.0.0.1:35743_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:45393_&core=shardSplitWithRule_shard1_0_replica_n5&coreNodeName=core_node10&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=3001
[junit4] 2> 916901 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 36443
[junit4] 2> 916901 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[C580C5964A2A5011]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 916901 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[C580C5964A2A5011]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33737 33737
[junit4] 2> 923101 INFO (Thread-2469) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33737 33737
[junit4] 2> 923102 WARN (Thread-2469) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2> 5 /solr/collections/collection1/terms/shard1
[junit4] 2> 5 /solr/collections/collection1/terms/shard2
[junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1_0
[junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1_1
[junit4] 2> 4 /solr/collections/collection1/state.json
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 51 /solr/collections/shardSplitWithRule/state.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_C580C5964A2A5011-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=PostingsFormat(name=Memory), a_t=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=PostingsFormat(name=Memory)}, docValues:{rnd_b=DocValuesFormat(name=Memory), _version_=DocValuesFormat(name=Lucene70), a_t=DocValuesFormat(name=Direct), a_i=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1075, maxMBSortInHeap=6.120791882715368, sim=RandomSimilarity(queryNorm=false): {}, locale=zh-HK, timezone=Asia/Thimphu
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=111376520,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestSchemaResource, DateMathParserTest, AliasIntegrationTest, SolrGraphiteReporterTest, RegexBoostProcessorTest, TestAnalyzeInfixSuggestions, CoreAdminCreateDiscoverTest, DataDrivenBlockJoinTest, TestPullReplicaErrorHandling, TestPushWriter, CloudMLTQParserTest, TestFiltering, DistanceFunctionTest, TestBulkSchemaAPI, TestInPlaceUpdatesDistrib, NoCacheHeaderTest, RecoveryAfterSoftCommitTest, MoveReplicaHDFSTest, TestAddFieldRealTimeGet, MergeStrategyTest, TestManagedSynonymFilterFactory, ConnectionReuseTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestMultiValuedNumericRangeQuery, TestRetrieveFieldsOptimizer, HLLUtilTest, TestRangeQuery, OverseerStatusTest, TestCloudPseudoReturnFields, SolrSlf4jReporterTest, TestDocBasedVersionConstraints, TestUtils, ZkShardTermsTest, ShardSplitTest]
[junit4] Completed [215/777 (1!)] on J2 in 232.05s, 5 tests, 1 failure, 1 skipped <<< FAILURES!
[...truncated 43163 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1456/consoleText
[repro] Revision: e2b3a97587a4387ab138252354d819ce253b625f
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=ShardSplitTest -Dtests.method=testSplitAfterFailedSplit -Dtests.seed=C580C5964A2A5011 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh-HK -Dtests.timezone=Asia/Thimphu -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] ShardSplitTest
[repro] ant compile-test
[...truncated 3315 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ShardSplitTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=C580C5964A2A5011 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh-HK -Dtests.timezone=Asia/Thimphu -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 123 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.api.collections.ShardSplitTest
[repro] Exiting with code 0
[...truncated 40 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.4) - Build # 1455 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1455/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([71909E92264CD1DA:88DD0D3D1A399C50]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:283)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 13008 lines...]
[junit4] Suite: org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4] 2> 774314 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/init-core-data-001
[junit4] 2> 774314 WARN (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=20 numCloses=20
[junit4] 2> 774314 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 774315 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
[junit4] 2> 774315 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_y/jo
[junit4] 2> 774316 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 774316 INFO (Thread-1604) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 774316 INFO (Thread-1604) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 774322 ERROR (Thread-1604) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 774416 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkTestServer start zk server on port:41619
[junit4] 2> 774420 INFO (zkConnectionManagerCallback-1248-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 774423 INFO (zkConnectionManagerCallback-1250-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 774425 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 774426 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 774427 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 774427 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 774428 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 774429 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 774429 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 774430 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 774431 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 774431 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 774432 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 774432 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 774519 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ebe1d33{/_y/jo,null,AVAILABLE}
[junit4] 2> 774520 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@725ea9d3{HTTP/1.1,[http/1.1]}{127.0.0.1:44519}
[junit4] 2> 774520 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @776393ms
[junit4] 2> 774520 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/control/data, hostPort=44519, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores, replicaType=NRT}
[junit4] 2> 774521 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:37.448255Z
[junit4] 2> 774522 INFO (zkConnectionManagerCallback-1252-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 774523 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 774523 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/solr.xml
[junit4] 2> 774524 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 774525 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 774525 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 774527 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr
[junit4] 2> 774528 INFO (zkConnectionManagerCallback-1256-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 774530 INFO (zkConnectionManagerCallback-1258-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 774588 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 774589 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44519__y%2Fjo
[junit4] 2> 774589 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.Overseer Overseer (id=72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) starting
[junit4] 2> 774603 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44519__y%2Fjo
[junit4] 2> 774606 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 774645 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 774654 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 774654 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 774655 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores
[junit4] 2> 774670 INFO (zkConnectionManagerCallback-1264-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 774671 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 774672 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41619/solr ready
[junit4] 2> 774673 INFO (qtp201282915-6805) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44519__y%252Fjo&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 774674 INFO (OverseerThreadFactory-2635-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 774778 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 774778 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 774884 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 775802 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 775809 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 775851 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 775860 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 776888 WARN (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 776913 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 776913 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 776914 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 776914 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 776914 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104
[junit4] 2> 776915 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4f117f1[control_collection_shard1_replica_n1] main]
[junit4] 2> 776916 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 776916 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 776917 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 776917 INFO (searcherExecutor-2638-thread-1-processing-n:127.0.0.1:44519__y%2Fjo x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@4f117f1[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 776918 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779106448670720
[junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44519/_y/jo/control_collection_shard1_replica_n1/
[junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:44519/_y/jo/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 776924 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44519/_y/jo/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 776924 INFO (zkCallback-1257-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 776974 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 776976 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2198
[junit4] 2> 776978 INFO (qtp201282915-6805) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 777076 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 777978 INFO (qtp201282915-6805) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44519__y%252Fjo&wt=javabin&version=2} status=0 QTime=3304
[junit4] 2> 777990 INFO (zkConnectionManagerCallback-1268-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 777991 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 777991 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41619/solr ready
[junit4] 2> 777991 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 777992 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 777993 INFO (OverseerThreadFactory-2635-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 777993 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 777993 WARN (OverseerThreadFactory-2635-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 778196 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 778196 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=204
[junit4] 2> 778277 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001 of type NRT
[junit4] 2> 778277 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e8303bc{/_y/jo,null,AVAILABLE}
[junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@65d1da9e{HTTP/1.1,[http/1.1]}{127.0.0.1:44709}
[junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @780152ms
[junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty1, hostPort=44709, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores}
[junit4] 2> 778279 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:41.206284Z
[junit4] 2> 778280 INFO (zkConnectionManagerCallback-1270-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 778281 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 778281 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/solr.xml
[junit4] 2> 778282 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 778282 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 778294 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 778296 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr
[junit4] 2> 778297 INFO (zkConnectionManagerCallback-1274-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 778299 INFO (zkConnectionManagerCallback-1276-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 778301 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 778302 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 778302 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44709__y%2Fjo
[junit4] 2> 778303 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 778303 INFO (zkCallback-1267-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 778303 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 778335 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 778342 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 778342 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 778343 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores
[junit4] 2> 778358 INFO (qtp201282915-6810) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44709__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 778359 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 778359 INFO (OverseerThreadFactory-2635-thread-3-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44709__y%2Fjo for creating new replica
[junit4] 2> 778361 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 778361 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 779369 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 779376 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 779433 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 779441 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 779459 WARN (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 779484 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 779484 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 779485 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 779485 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 779486 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104
[junit4] 2> 779486 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@79e1a486[collection1_shard2_replica_n41] main]
[junit4] 2> 779487 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 779487 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 779488 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 779488 INFO (searcherExecutor-2649-thread-1-processing-n:127.0.0.1:44709__y%2Fjo x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@79e1a486[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 779488 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779109143511040
[junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/
[junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 779493 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/ shard2
[junit4] 2> 779644 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 779645 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1284
[junit4] 2> 779646 INFO (qtp201282915-6810) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44709__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1288
[junit4] 2> 779753 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001 of type NRT
[junit4] 2> 779753 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 779754 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 779754 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 779754 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5fe0cd84{/_y/jo,null,AVAILABLE}
[junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@702880b3{HTTP/1.1,[http/1.1]}{127.0.0.1:45679}
[junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @781628ms
[junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty2, hostPort=45679, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores}
[junit4] 2> 779755 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:42.683207Z
[junit4] 2> 779757 INFO (zkConnectionManagerCallback-1280-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 779758 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 779758 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/solr.xml
[junit4] 2> 779760 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 779760 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 779760 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 779762 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr
[junit4] 2> 779763 INFO (zkConnectionManagerCallback-1284-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 779764 INFO (zkConnectionManagerCallback-1286-thread-1-processing-n:127.0.0.1:45679__y%2Fjo) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 779766 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 779767 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 779767 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45679__y%2Fjo
[junit4] 2> 779768 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 779768 INFO (zkCallback-1267-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 779768 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 779768 INFO (zkCallback-1285-thread-1-processing-n:127.0.0.1:45679__y%2Fjo) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 779800 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 779807 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 779807 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 779808 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores
[junit4] 2> 779829 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:45679__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 779830 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 779830 INFO (OverseerThreadFactory-2635-thread-4-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:45679__y%2Fjo for creating new replica
[junit4] 2> 779832 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 779832 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 780843 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 780861 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 780905 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 780912 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 780912 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 780912 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 780913 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 780915 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 781019 WARN (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 781045 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 781045 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 781046 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 781046 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 781046 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104
[junit4] 2> 781047 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@49db72f2[collection1_shard1_replica_n43] main]
[junit4] 2> 781047 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 781048 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 781048 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 781049 INFO (searcherExecutor-2660-thread-1-processing-n:127.0.0.1:45679__y%2Fjo x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@49db72f2[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 781049 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779110780338176
[junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45679/_y/jo/collection1_shard1_replica_n43/
[junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:45679/_y/jo/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 781053 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45679/_y/jo/collection1_shard1_replica_n43/ shard1
[junit4] 2> 781204 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 781206 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1373
[junit4] 2> 781207 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:45679__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1377
[junit4] 2> 781287 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001 of type NRT
[junit4] 2> 781288 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@352ed26f{/_y/jo,null,AVAILABLE}
[junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5e656c39{HTTP/1.1,[http/1.1]}{127.0.0.1:33199}
[junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @783162ms
[junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty3, hostPort=33199, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores, replicaType=NRT}
[junit4] 2> 781290 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:44.217364Z
[junit4] 2> 781291 INFO (zkConnectionManagerCallback-1290-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 781292 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 781292 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/solr.xml
[junit4] 2> 781293 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 781293 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 781294 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 781295 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr
[junit4] 2> 781296 INFO (zkConnectionManagerCallback-1294-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 781298 INFO (zkConnectionManagerCallback-1296-thread-1-processing-n:127.0.0.1:33199__y%2Fjo) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 781300 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 781301 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 781301 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33199__y%2Fjo
[junit4] 2> 781302 INFO (zkCallback-1285-thread-1-processing-n:127.0.0.1:45679__y%2Fjo) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 781302 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 781302 INFO (zkCallback-1257-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 781302 INFO (zkCallback-1267-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 781302 INFO (zkCallback-1295-thread-1-processing-n:127.0.0.1:33199__y%2Fjo) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 781326 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 781345 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 781345 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 781346 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores
[junit4] 2> 781371 INFO (qtp84018367-6918) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33199__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 781372 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 781372 INFO (OverseerThreadFactory-2635-thread-5-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:33199__y%2Fjo for creating new replica
[junit4] 2> 781373 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 781374 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 782707 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 782713 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
[junit4] 2> 782757 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
[junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42
[junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
[junit4] 2> 782765 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 782784 WARN (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 782817 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 782817 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 782818 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 782818 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 782818 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104
[junit4] 2> 782819 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@b0bebf0[collection1_shard2_replica_n45] main]
[junit4] 2> 782819 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 782820 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 782820 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 782821 INFO (searcherExecutor-2671-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [collection1_shard2_replica_n45] Registered new searcher Searcher@b0bebf0[collection1_shard2_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 782821 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779112638414848
[junit4] 2> 782823 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n45
[junit4] 2> 782823 INFO (updateExecutor-1291-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 782824 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 782824 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 782824 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1450
[junit4] 2> 782825 INFO (qtp84018367-6918) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33199__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1454
[junit4] 2> 782825 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp=/_y/jo path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 782826 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp=/_y/jo path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 782826 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n45]
[junit4] 2> 782826 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 782826 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n45] as recovering, leader is [http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/] and I am [http://127.0.0.1:33199/_y/jo/collection1_shard2_replica_n45/]
[junit4] 2> 782834 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:44709/_y/jo]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:33199__y%252Fjo&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 782835 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 782836 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:33199__y%2Fjo, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:33199/_y/jo","node_name":"127.0.0.1:33199__y%2Fjo","state":"down","type":"NRT"}
[junit4] 2> 782934 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-4-001 of type NRT
[junit4] 2> 782934 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5732113a{/_y/jo,null,AVAILABLE}
[junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ec6b9d0{HTTP/1.1,[http/1.1]}{127.0.0.1:45025}
[junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @784809ms
[junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty4, hostPort=45025, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-4-001/cores, replicaType=NRT}
[junit4] 2> 782936 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:45.863803Z
[junit4] 2> 782937 INFO (zkConnectionManagerCallback-1301-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 782938 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 782938 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-4-001/solr.xml
[junit4] 2> 782940 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 782940 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 782941
[...truncated too long message...]
(zkCallback-1490-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.c.SolrCore [collection1_shard1_replica_t47] CLOSING SolrCore org.apache.solr.core.SolrCore@7ff8b794
[junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_t47, tag=2147006356
[junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.c.SolrCore [shardSplitWithRule_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@1c80ac73
[junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c0c0bd5: rootName = null, domain = solr.core.collection1.shard1.replica_t47, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_t47 / com.codahale.metrics.MetricRegistry@41c129d1
[junit4] 2> 988199 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=2147006356
[junit4] 2> 988199 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.shardSplitWithRule.shard1.replica_n2, tag=478194803
[junit4] 2> 988199 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@583687c0: rootName = null, domain = solr.core.shardSplitWithRule.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.shardSplitWithRule.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@71520271
[junit4] 2> 988204 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.shardSplitWithRule.shard1.leader, tag=478194803
[junit4] 2> 988216 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.s.c.Overseer Overseer (id=72063096710168594-127.0.0.1:45651__y%2Fjo-n_0000000004) closing
[junit4] 2> 988216 INFO (OverseerStateUpdate-72063096710168594-127.0.0.1:45651__y%2Fjo-n_0000000004) [n:127.0.0.1:45651__y%2Fjo ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45651__y%2Fjo
[junit4] 2> 988216 WARN (OverseerAutoScalingTriggerThread-72063096710168594-127.0.0.1:45651__y%2Fjo-n_0000000004) [n:127.0.0.1:45651__y%2Fjo ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 988218 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@21e08141{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 988218 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@77cc217b{/_y/jo,null,UNAVAILABLE}
[junit4] 2> 988218 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 988219 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 33079
[junit4] 2> 988219 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 988219 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35875 35875
[junit4] 2> 993331 INFO (Thread-1820) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35875 35875
[junit4] 2> 993331 WARN (Thread-1820) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2> 5 /solr/collections/collection1/terms/shard1
[junit4] 2> 5 /solr/collections/collection1/terms/shard2
[junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1_0
[junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1_1
[junit4] 2> 4 /solr/collections/collection1/state.json
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 48 /solr/collections/shardSplitWithRule/state.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 3 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2>
[junit4] IGNOR/A 0.00s J2 | ShardSplitTest.test
[junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=BlockTreeOrds(blocksize=128), a_t=PostingsFormat(name=Direct), id=BlockTreeOrds(blocksize=128)}, docValues:{rnd_b=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Lucene70), a_t=DocValuesFormat(name=Asserting), a_i=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1064, maxMBSortInHeap=7.702639317728574, sim=RandomSimilarity(queryNorm=false): {}, locale=sv, timezone=Europe/Saratov
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=231820848,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [NodeMutatorTest, SolrCmdDistributorTest, RegexBoostProcessorTest, TestFieldCacheVsDocValues, IndexSchemaRuntimeFieldTest, TestReplicaProperties, TestAuthorizationFramework, TestSha256AuthenticationProvider, HdfsNNFailoverTest, TestTrackingShardHandlerFactory, CloudMLTQParserTest, TestExpandComponent, TestSolr4Spatial2, TestFilteredDocIdSet, ConvertedLegacyTest, DisMaxRequestHandlerTest, TriggerIntegrationTest, SharedFSAutoReplicaFailoverTest, TestManagedSchemaThreadSafety, TestUpdate, TestSchemaResource, TestDFISimilarityFactory, TestStandardQParsers, SecurityConfHandlerTest, AliasIntegrationTest, CollectionTooManyReplicasTest, TestXmlQParser, TestDistributedMissingSort, CoreAdminHandlerTest, TestDFRSimilarityFactory, TestSegmentSorting, DistributedSpellCheckComponentTest, NoCacheHeaderTest, ManagedSchemaRoundRobinCloudTest, DeleteReplicaTest, CacheHeaderTest, RegexBytesRefFilterTest, TestBlobHandler, TestFaceting, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestUseDocValuesAsStored2, DeleteInactiveReplicaTest, DistanceUnitsTest, TestLargeCluster, TestMissingGroups, TestScoreJoinQPNoScore, TestShardHandlerFactory, TestMacros, TestJmxIntegration, SpellCheckComponentTest, TestAtomicUpdateErrorCases, TestLegacyFieldReuse, TestSolrDeletionPolicy2, RecoveryZkTest, TimeRoutedAliasUpdateProcessorTest, PreAnalyzedFieldTest, ConnectionReuseTest, TestLazyCores, TestReRankQParserPlugin, HdfsBasicDistributedZkTest, ShardSplitTest]
[junit4] Completed [270/777 (1!)] on J2 in 219.03s, 5 tests, 1 failure, 1 skipped <<< FAILURES!
[...truncated 43088 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1455/consoleText
[repro] Revision: 9363529f4bffc98be3955e2e0e0229eebeb43a5a
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=ShardSplitTest -Dtests.method=testSplitAfterFailedSplit -Dtests.seed=71909E92264CD1DA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sv -Dtests.timezone=Europe/Saratov -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] ShardSplitTest
[repro] ant compile-test
[...truncated 3315 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ShardSplitTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=71909E92264CD1DA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sv -Dtests.timezone=Europe/Saratov -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 117 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.api.collections.ShardSplitTest
[repro] Exiting with code 0
[...truncated 40 lines...]