You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/04/22 05:53:27 UTC
[JENKINS] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk-9.0.4) - Build
# 26 - Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/26/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.SSLMigrationTest.test
Error Message:
Replica didn't have the proper urlScheme in the ClusterState
Stack Trace:
java.lang.AssertionError: Replica didn't have the proper urlScheme in the ClusterState
at __randomizedtesting.SeedInfo.seed([C97C727AF8E71B50:41284DA0561B76A8]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.SSLMigrationTest.assertReplicaInformation(SSLMigrationTest.java:104)
at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:97)
at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 13026 lines...]
[junit4] Suite: org.apache.solr.cloud.SSLMigrationTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/init-core-data-001
[junit4] 2> 552835 WARN (SUITE-SSLMigrationTest-seed#[C97C727AF8E71B50]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 552835 INFO (SUITE-SSLMigrationTest-seed#[C97C727AF8E71B50]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 552835 INFO (SUITE-SSLMigrationTest-seed#[C97C727AF8E71B50]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None")
[junit4] 2> 552836 INFO (SUITE-SSLMigrationTest-seed#[C97C727AF8E71B50]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 552836 INFO (SUITE-SSLMigrationTest-seed#[C97C727AF8E71B50]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 552837 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 552837 INFO (Thread-1319) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 552837 INFO (Thread-1319) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 552838 ERROR (Thread-1319) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 552937 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkTestServer start zk server on port:40283
[junit4] 2> 552938 INFO (zkConnectionManagerCallback-1381-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 552940 INFO (zkConnectionManagerCallback-1383-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 552941 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 552942 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 552943 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 552943 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 552944 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 552944 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 552945 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 552945 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 552946 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 552946 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 552946 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 552947 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 553023 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 553024 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 553024 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 553024 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 553024 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2af4037{/,null,AVAILABLE}
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2a74aaec{HTTP/1.1,[http/1.1]}{127.0.0.1:36819}
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server Started @553059ms
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/tempDir-001/control/data, hostPort=36819, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/control-001/cores, replicaType=NRT}
[junit4] 2> 553025 ERROR (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 553025 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-22T05:00:02.802667Z
[junit4] 2> 553026 INFO (zkConnectionManagerCallback-1385-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 553026 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 553027 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/control-001/solr.xml
[junit4] 2> 553028 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 553028 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 553028 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 553030 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40283/solr
[junit4] 2> 553031 INFO (zkConnectionManagerCallback-1389-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 553032 INFO (zkConnectionManagerCallback-1391-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 553064 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 553064 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36819_
[junit4] 2> 553065 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.c.Overseer Overseer (id=72181511347306500-127.0.0.1:36819_-n_0000000000) starting
[junit4] 2> 553068 INFO (zkConnectionManagerCallback-1398-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 553069 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40283/solr ready
[junit4] 2> 553069 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36819_
[junit4] 2> 553069 INFO (OverseerStateUpdate-72181511347306500-127.0.0.1:36819_-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 553072 INFO (zkCallback-1397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 553125 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 553132 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 553132 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 553133 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:36819_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/control-001/cores
[junit4] 2> 553145 INFO (zkConnectionManagerCallback-1403-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 553146 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 553146 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40283/solr ready
[junit4] 2> 553148 INFO (qtp1346833812-5147) [n:127.0.0.1:36819_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36819_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 553154 INFO (OverseerThreadFactory-1415-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 553257 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 553257 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 554292 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 554309 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 554378 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 554387 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 554387 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 554388 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 554388 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 554390 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=97.498046875, floorSegmentMB=2.056640625, forceMergeDeletesPctAllowed=15.235263732468685, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5403003689927836
[junit4] 2> 554391 WARN (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 554424 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 554425 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 554425 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 554425 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 554426 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=62.345703125, floorSegmentMB=1.5693359375, forceMergeDeletesPctAllowed=12.86758656463135, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 554427 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@305c2ea8[control_collection_shard1_replica_n1] main]
[junit4] 2> 554427 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 554427 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 554428 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 554429 INFO (searcherExecutor-1418-thread-1-processing-n:127.0.0.1:36819_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@305c2ea8[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 554443 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1598421156988190720
[junit4] 2> 554446 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 554447 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 554447 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 554447 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36819/control_collection_shard1_replica_n1/
[junit4] 2> 554447 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 554447 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:36819/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 554447 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 554448 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36819/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 554549 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 554550 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1293
[junit4] 2> 554555 INFO (qtp1346833812-5147) [n:127.0.0.1:36819_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 554650 INFO (zkCallback-1390-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 555158 INFO (OverseerCollectionConfigSetProcessor-72181511347306500-127.0.0.1:36819_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 555555 INFO (qtp1346833812-5147) [n:127.0.0.1:36819_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36819_&wt=javabin&version=2} status=0 QTime=2407
[junit4] 2> 555558 INFO (zkConnectionManagerCallback-1408-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 555558 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 555559 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40283/solr ready
[junit4] 2> 555559 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 555559 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 555560 INFO (OverseerThreadFactory-1415-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 555560 WARN (OverseerThreadFactory-1415-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 555764 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 555764 INFO (qtp1346833812-5153) [n:127.0.0.1:36819_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=204
[junit4] 2> 555847 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-1-001 of type NRT
[junit4] 2> 555847 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 555848 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 555848 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 555848 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 555848 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a31e90f{/,null,AVAILABLE}
[junit4] 2> 555848 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2731e92e{HTTP/1.1,[http/1.1]}{127.0.0.1:44533}
[junit4] 2> 555848 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server Started @555883ms
[junit4] 2> 555848 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/tempDir-001/jetty1, hostPort=44533, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-1-001/cores, replicaType=NRT}
[junit4] 2> 555849 ERROR (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 555849 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 555849 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 555849 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 555849 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 555849 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-22T05:00:05.626360Z
[junit4] 2> 555850 INFO (zkConnectionManagerCallback-1410-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 555850 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 555850 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-1-001/solr.xml
[junit4] 2> 555852 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 555852 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 555853 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 555855 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40283/solr
[junit4] 2> 555869 INFO (zkConnectionManagerCallback-1414-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 555870 INFO (zkConnectionManagerCallback-1416-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 555872 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 555873 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 555874 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 555874 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44533_
[junit4] 2> 555874 INFO (zkCallback-1407-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 555874 INFO (zkCallback-1390-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 555874 INFO (zkCallback-1397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 555874 INFO (zkCallback-1415-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 555949 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 555954 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 555955 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 555955 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-1-001/cores
[junit4] 2> 555957 INFO (zkConnectionManagerCallback-1423-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 555957 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 555958 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:44533_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40283/solr ready
[junit4] 2> 555970 INFO (qtp1346833812-5189) [n:127.0.0.1:36819_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44533_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 555971 INFO (OverseerCollectionConfigSetProcessor-72181511347306500-127.0.0.1:36819_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 555971 INFO (OverseerThreadFactory-1415-thread-3) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44533_ for creating new replica
[junit4] 2> 555972 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 556979 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 556988 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 557058 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 557064 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 557065 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 557065 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 557065 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 557066 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=97.498046875, floorSegmentMB=2.056640625, forceMergeDeletesPctAllowed=15.235263732468685, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5403003689927836
[junit4] 2> 557067 WARN (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 557091 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 557091 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 557092 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 557092 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 557093 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=62.345703125, floorSegmentMB=1.5693359375, forceMergeDeletesPctAllowed=12.86758656463135, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 557093 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@1bb9a0b[collection1_shard2_replica_n41] main]
[junit4] 2> 557093 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 557093 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 557094 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 557095 INFO (searcherExecutor-1429-thread-1-processing-n:127.0.0.1:44533_ x:collection1_shard2_replica_n41 c:collection1 s:shard2) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@1bb9a0b[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 557095 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1598421159769014272
[junit4] 2> 557098 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0}, version=0}
[junit4] 2> 557099 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 557099 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 557099 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44533/collection1_shard2_replica_n41/
[junit4] 2> 557099 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 557099 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:44533/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 557099 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 557100 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44533/collection1_shard2_replica_n41/ shard2
[junit4] 2> 557251 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 557262 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1290
[junit4] 2> 557264 INFO (qtp1346833812-5189) [n:127.0.0.1:36819_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44533_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1293
[junit4] 2> 557343 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-2-001 of type NRT
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1eb9177d{/,null,AVAILABLE}
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@cfdc7b{HTTP/1.1,[http/1.1]}{127.0.0.1:33757}
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server Started @557380ms
[junit4] 2> 557345 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/tempDir-001/jetty2, hostPort=33757, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-2-001/cores, replicaType=NRT}
[junit4] 2> 557346 ERROR (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 557346 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 557346 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 557346 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 557346 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 557346 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-22T05:00:07.123516Z
[junit4] 2> 557347 INFO (zkConnectionManagerCallback-1425-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 557348 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 557348 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-2-001/solr.xml
[junit4] 2> 557349 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 557349 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 557349 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 557351 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40283/solr
[junit4] 2> 557352 INFO (zkConnectionManagerCallback-1429-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 557353 INFO (zkConnectionManagerCallback-1431-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 557356 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 557356 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 557357 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 557357 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33757_
[junit4] 2> 557358 INFO (zkCallback-1422-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 557358 INFO (zkCallback-1390-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 557358 INFO (zkCallback-1407-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 557358 INFO (zkCallback-1397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 557358 INFO (zkCallback-1415-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 557358 INFO (zkCallback-1430-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 557434 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 557439 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 557439 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 557440 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-2-001/cores
[junit4] 2> 557442 INFO (zkConnectionManagerCallback-1438-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 557442 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 557443 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:33757_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40283/solr ready
[junit4] 2> 557480 INFO (qtp84450015-5237) [n:127.0.0.1:33757_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33757_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 557482 INFO (OverseerCollectionConfigSetProcessor-72181511347306500-127.0.0.1:36819_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 557482 INFO (OverseerThreadFactory-1415-thread-4) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:33757_ for creating new replica
[junit4] 2> 557483 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 558490 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 558499 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 558572 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 558579 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 558580 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 558580 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 558580 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 558582 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=97.498046875, floorSegmentMB=2.056640625, forceMergeDeletesPctAllowed=15.235263732468685, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5403003689927836
[junit4] 2> 558583 WARN (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 558615 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 558615 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 558616 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 558616 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 558616 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=62.345703125, floorSegmentMB=1.5693359375, forceMergeDeletesPctAllowed=12.86758656463135, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 558616 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@22022993[collection1_shard1_replica_n43] main]
[junit4] 2> 558617 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 558617 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 558617 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 558618 INFO (searcherExecutor-1440-thread-1-processing-n:127.0.0.1:33757_ x:collection1_shard1_replica_n43 c:collection1 s:shard1) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@22022993[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 558618 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1598421161365995520
[junit4] 2> 558621 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node44=0}, version=0}
[junit4] 2> 558621 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 558621 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 558621 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33757/collection1_shard1_replica_n43/
[junit4] 2> 558621 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 558621 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:33757/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 558621 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 558623 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33757/collection1_shard1_replica_n43/ shard1
[junit4] 2> 558773 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 558775 INFO (qtp84450015-5243) [n:127.0.0.1:33757_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1291
[junit4] 2> 558777 INFO (qtp84450015-5237) [n:127.0.0.1:33757_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33757_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1296
[junit4] 2> 558873 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-3-001 of type NRT
[junit4] 2> 558874 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 558875 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 558875 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 558875 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 558875 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@613a7a63{/,null,AVAILABLE}
[junit4] 2> 558875 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6f1efa74{HTTP/1.1,[http/1.1]}{127.0.0.1:39985}
[junit4] 2> 558875 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server Started @558910ms
[junit4] 2> 558875 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/tempDir-001/jetty3, hostPort=39985, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-3-001/cores}
[junit4] 2> 558876 ERROR (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 558876 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 558876 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 558876 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 558876 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 558876 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-22T05:00:08.653442Z
[junit4] 2> 558877 INFO (zkConnectionManagerCallback-1440-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558878 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 558878 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-3-001/solr.xml
[junit4] 2> 558879 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 558879 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 558880 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 558882 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40283/solr
[junit4] 2> 558884 INFO (zkConnectionManagerCallback-1444-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558885 INFO (zkConnectionManagerCallback-1446-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558888 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 558889 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 558890 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 558890 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39985_
[junit4] 2> 558891 INFO (zkCallback-1407-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558891 INFO (zkCallback-1430-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558891 INFO (zkCallback-1437-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558891 INFO (zkCallback-1397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558891 INFO (zkCallback-1415-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558891 INFO (zkCallback-1422-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558891 INFO (zkCallback-1390-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558891 INFO (zkCallback-1445-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 558933 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 558939 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 558939 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 558940 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-3-001/cores
[junit4] 2> 558941 INFO (zkConnectionManagerCallback-1453-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 558942 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 558942 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:39985_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40283/solr ready
[junit4] 2> 558971 INFO (qtp84450015-5241) [n:127.0.0.1:33757_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39985_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 558972 INFO (OverseerCollectionConfigSetProcessor-72181511347306500-127.0.0.1:36819_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 558973 INFO (OverseerThreadFactory-1415-thread-5) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:39985_ for creating new replica
[junit4] 2> 558974 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 560009 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 560029 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
[junit4] 2> 560086 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 560092 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
[junit4] 2> 560092 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849
[junit4] 2> 560092 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 560092 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
[junit4] 2> 560094 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=97.498046875, floorSegmentMB=2.056640625, forceMergeDeletesPctAllowed=15.235263732468685, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5403003689927836
[junit4] 2> 560096 WARN (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 560128 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 560128 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 560139 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 560139 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 560140 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=62.345703125, floorSegmentMB=1.5693359375, forceMergeDeletesPctAllowed=12.86758656463135, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 560140 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@1fddf3bf[collection1_shard2_replica_n45] main]
[junit4] 2> 560141 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 560141 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 560142 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 560143 INFO (searcherExecutor-1451-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [collection1_shard2_replica_n45] Registered new searcher Searcher@1fddf3bf[collection1_shard2_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 560143 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1598421162965073920
[junit4] 2> 560146 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0, core_node46=0}, version=1}
[junit4] 2> 560147 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n45
[junit4] 2> 560147 INFO (updateExecutor-1441-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 560147 INFO (recoveryExecutor-1442-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 560147 INFO (recoveryExecutor-1442-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 560148 INFO (qtp1299263773-5274) [n:127.0.0.1:39985_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1174
[junit4] 2> 560149 INFO (qtp691929974-5208) [n:127.0.0.1:44533_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 560149 INFO (qtp691929974-5208) [n:127.0.0.1:44533_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 560149 INFO (qtp84450015-5241) [n:127.0.0.1:33757_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39985_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1178
[junit4] 2> 560149 INFO (recoveryExecutor-1442-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n45]
[junit4] 2> 560149 INFO (recoveryExecutor-1442-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 560149 INFO (recoveryExecutor-1442-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n45] as recovering, leader is [http://127.0.0.1:44533/collection1_shard2_replica_n41/] and I am [http://127.0.0.1:39985/collection1_shard2_replica_n45/]
[junit4] 2> 560150 INFO (recoveryExecutor-1442-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0, core_node46=0, core_node46_recovering=0}, version=2}
[junit4] 2> 560151 INFO (recoveryExecutor-1442-thread-1-processing-n:127.0.0.1:39985_ x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39985_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:44533]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:39985_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 560151 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 560152 INFO (qtp691929974-5202) [n:127.0.0.1:44533_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:39985_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:39985","node_name":"127.0.0.1:39985_","state":"down","type":"NRT"}
[junit4] 2> 560218 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-4-001 of type NRT
[junit4] 2> 560219 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 560219 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 560219 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 560219 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 560219 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b5e7abe{/,null,AVAILABLE}
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1a111350{HTTP/1.1,[http/1.1]}{127.0.0.1:41155}
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.Server Started @560254ms
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/tempDir-001/jetty4, hostPort=41155, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-4-001/cores}
[junit4] 2> 560220 ERROR (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 560220 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-22T05:00:09.997810Z
[junit4] 2> 560221 INFO (zkConnectionManagerCallback-1456-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 560222 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 560222 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001/shard-4-001/solr.xml
[junit4] 2> 560223 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 560223 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 560224 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7f379849, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 560225 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40283/solr
[junit4] 2> 560226 INFO (zkConnectionManagerCallback-1460-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 560227 INFO (zkConnectionManagerCallback-1462-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 560229 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [n:127.0.0.1:41155_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 560244 INFO (TEST
[...truncated too long message...]
eader, tag=6613ada3
[junit4] 2> 571400 ERROR (coreZkRegister-1508-thread-1-processing-n:127.0.0.1:41155_ x:collection1_shard1_replica_n47 c:collection1 s:shard1 r:core_node48) [n:127.0.0.1:41155_ c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.c.ZkController Error getting leader from zk
[junit4] 2> org.apache.solr.common.SolrException: CoreContainer is closed
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1283) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1250) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1206) [java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1090) [java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1021) [java/:?]
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:187) [java/:?]
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192) [java/:?]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) [?:?]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) [?:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?]
[junit4] 2> 571400 ERROR (coreZkRegister-1508-thread-1-processing-n:127.0.0.1:41155_ x:collection1_shard1_replica_n47 c:collection1 s:shard1 r:core_node48) [n:127.0.0.1:41155_ c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard1
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1239)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1090)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1021)
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:187)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: CoreContainer is closed
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1283)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1250)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1206)
[junit4] 2> ... 7 more
[junit4] 2>
[junit4] 2> 571401 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@18ede990{SSL,[ssl, http/1.1]}{127.0.0.1:41155}
[junit4] 2> 571401 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@60d2eb9b{/,null,UNAVAILABLE}
[junit4] 2> 571401 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 571409 ERROR (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 571417 INFO (TEST-SSLMigrationTest.test-seed#[C97C727AF8E71B50]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40283 40283
[junit4] 2> 571615 INFO (Thread-1319) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40283 40283
[junit4] 2> 571615 WARN (Thread-1319) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 20 /solr/aliases.json
[junit4] 2> 13 /solr/collections/collection1/state.json
[junit4] 2> 9 /solr/security.json
[junit4] 2> 9 /solr/configs/conf1
[junit4] 2> 9 /solr/collections/collection1/terms/shard1
[junit4] 2> 9 /solr/collections/collection1/terms/shard2
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 20 /solr/clusterprops.json
[junit4] 2> 20 /solr/clusterstate.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2> 5 /solr/overseer_elect/election/72181511347306500-127.0.0.1:36819_-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 20 /solr/live_nodes
[junit4] 2> 20 /solr/collections
[junit4] 2> 5 /solr/autoscaling/events/.scheduled_maintenance
[junit4] 2> 5 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SSLMigrationTest -Dtests.method=test -Dtests.seed=C97C727AF8E71B50 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-Cyrl-ME -Dtests.timezone=Europe/Zurich -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 18.8s J1 | SSLMigrationTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Replica didn't have the proper urlScheme in the ClusterState
[junit4] > at __randomizedtesting.SeedInfo.seed([C97C727AF8E71B50:41284DA0561B76A8]:0)
[junit4] > at org.apache.solr.cloud.SSLMigrationTest.assertReplicaInformation(SSLMigrationTest.java:104)
[junit4] > at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:97)
[junit4] > at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_C97C727AF8E71B50-001
[junit4] 2> Apr 22, 2018 5:00:21 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=273, maxMBSortInHeap=6.38903666708897, sim=RandomSimilarity(queryNorm=false): {}, locale=sr-Cyrl-ME, timezone=Europe/Zurich
[junit4] 2> NOTE: Linux 4.13.0-37-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=322594528,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [JSONWriterTest, DistributedMLTComponentTest, BasicZkTest, OverseerTaskQueueTest, TestFastLRUCache, TestAnalyzeInfixSuggestions, DOMUtilTest, TestEmbeddedSolrServerSchemaAPI, V2ApiIntegrationTest, TestRawResponseWriter, TestLegacyField, ConnectionManagerTest, FullHLLTest, TestSimpleQParserPlugin, TestRestoreCore, MoveReplicaHDFSFailoverTest, TestCollapseQParserPlugin, TestRandomCollapseQParserPlugin, TestSolrXml, QueryEqualityTest, CursorMarkTest, IndexSizeTriggerTest, ScheduledMaintenanceTriggerTest, TestSearchPerf, TestStressRecovery, SignatureUpdateProcessorFactoryTest, TestPolicyCloud, IndexSchemaTest, ZkStateWriterTest, OverseerTest, RemoteQueryErrorTest, UUIDUpdateProcessorFallbackTest, DeleteReplicaTest, TestGraphTermsQParserPlugin, TestCloudSchemaless, UpdateRequestProcessorFactoryTest, TestCustomSort, TestLegacyFieldCache, PeerSyncTest, TestClusterProperties, TestLeaderInitiatedRecoveryThread, SSLMigrationTest]
[junit4] Completed [195/802 (1!)] on J1 in 19.05s, 1 test, 1 failure <<< FAILURES!
[...truncated 45747 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/26/consoleText
[repro] Revision: b16b380b2cec1614597df6a045599307628988c2
[repro] Repro line: ant test -Dtestcase=SSLMigrationTest -Dtests.method=test -Dtests.seed=C97C727AF8E71B50 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-Cyrl-ME -Dtests.timezone=Europe/Zurich -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] SSLMigrationTest
[repro] ant compile-test
[...truncated 3321 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.SSLMigrationTest" -Dtests.showOutput=onerror -Dtests.seed=C97C727AF8E71B50 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-Cyrl-ME -Dtests.timezone=Europe/Zurich -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 76 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.SSLMigrationTest
[repro] Exiting with code 0
[...truncated 40 lines...]
[JENKINS] Lucene-Solr-BadApples-7.x-Linux (32bit/jdk1.8.0_162) -
Build # 28 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/28/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState
Error Message:
Did not expect the processor to fire on first run! event={ "id":"7f47f11889b16T2qygrv69br349kp1up7n8u91u", "source":"node_added_trigger", "eventTime":2239151429163798, "eventType":"NODEADDED", "properties":{ "eventTimes":[ 2239151429163798, 2239151429166188, 2239151429166744], "nodeNames":[ "127.0.0.1:38799_solr", "127.0.0.1:39837_solr", "127.0.0.1:34837_solr"]}}
Stack Trace:
java.lang.AssertionError: Did not expect the processor to fire on first run! event={
"id":"7f47f11889b16T2qygrv69br349kp1up7n8u91u",
"source":"node_added_trigger",
"eventTime":2239151429163798,
"eventType":"NODEADDED",
"properties":{
"eventTimes":[
2239151429163798,
2239151429166188,
2239151429166744],
"nodeNames":[
"127.0.0.1:38799_solr",
"127.0.0.1:39837_solr",
"127.0.0.1:34837_solr"]}}
at __randomizedtesting.SeedInfo.seed([CCCBF8AE1E1EF137:2655C3DE6278921]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.lambda$new$0(NodeAddedTriggerTest.java:49)
at org.apache.solr.cloud.autoscaling.NodeAddedTrigger.run(NodeAddedTrigger.java:161)
at org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState(NodeAddedTriggerTest.java:257)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 14418 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest
[junit4] 2> 2531234 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/init-core-data-001
[junit4] 2> 2531234 WARN (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
[junit4] 2> 2531235 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2531236 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2531237 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/tempDir-001
[junit4] 2> 2531237 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2531237 INFO (Thread-9058) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2531237 INFO (Thread-9058) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2531239 ERROR (Thread-9058) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2531337 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46501
[junit4] 2> 2531340 INFO (zkConnectionManagerCallback-10376-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2531346 INFO (jetty-launcher-10373-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2531347 INFO (jetty-launcher-10373-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2531347 INFO (jetty-launcher-10373-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2531347 INFO (jetty-launcher-10373-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2531347 INFO (jetty-launcher-10373-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e0b28{/solr,null,AVAILABLE}
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7f2af4{SSL,[ssl, http/1.1]}{127.0.0.1:38799}
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.e.j.s.Server Started @2531378ms
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38799}
[junit4] 2> 2531348 ERROR (jetty-launcher-10373-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2531348 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-26T05:45:09.860Z
[junit4] 2> 2531350 INFO (zkConnectionManagerCallback-10378-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2531350 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2531360 INFO (jetty-launcher-10373-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46501/solr
[junit4] 2> 2531362 INFO (zkConnectionManagerCallback-10382-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2531364 INFO (zkConnectionManagerCallback-10384-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2531406 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2531406 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38799_solr
[junit4] 2> 2531407 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.c.Overseer Overseer (id=72204338003705859-127.0.0.1:38799_solr-n_0000000000) starting
[junit4] 2> 2531411 INFO (zkConnectionManagerCallback-10391-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2531413 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46501/solr ready
[junit4] 2> 2531413 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38799_solr
[junit4] 2> 2531414 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2531414 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2533069 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38799.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2533079 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38799.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2533079 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38799.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2533080 INFO (jetty-launcher-10373-thread-1) [n:127.0.0.1:38799_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/tempDir-001/node1/.
[junit4] 2> 2533097 INFO (zkConnectionManagerCallback-10393-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2533102 INFO (zkConnectionManagerCallback-10398-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2533103 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2533104 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46501/solr ready
[junit4] 2> 2533123 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger
[junit4] 2> 2533125 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2533126 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2533126 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2533126 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2533127 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c4790a{/solr,null,AVAILABLE}
[junit4] 2> 2533127 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1c8e3a6{SSL,[ssl, http/1.1]}{127.0.0.1:39837}
[junit4] 2> 2533127 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server Started @2533157ms
[junit4] 2> 2533127 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39837}
[junit4] 2> 2533128 ERROR (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2533128 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2533128 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 2533128 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2533128 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2533128 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-26T05:45:11.640Z
[junit4] 2> 2533130 INFO (zkConnectionManagerCallback-10400-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2533131 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2533144 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46501/solr
[junit4] 2> 2533146 INFO (zkConnectionManagerCallback-10404-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2533148 INFO (zkConnectionManagerCallback-10406-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2533153 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2533154 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2533155 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2533155 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39837_solr
[junit4] 2> 2533156 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2533156 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2533156 INFO (zkCallback-10397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2533156 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2535284 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39837.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2535294 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39837.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2535294 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39837.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2535295 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/tempDir-001/node2/.
[junit4] 2> 2535299 INFO (zkConnectionManagerCallback-10413-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2535300 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2535301 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:39837_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46501/solr ready
[junit4] 2> 2535329 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2535330 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2535330 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2535330 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2535330 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ae9c7{/solr,null,AVAILABLE}
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@dfaf83{SSL,[ssl, http/1.1]}{127.0.0.1:34837}
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server Started @2535361ms
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34837}
[junit4] 2> 2535331 ERROR (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2535331 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-26T05:45:13.843Z
[junit4] 2> 2535333 INFO (zkConnectionManagerCallback-10415-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2535333 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2535345 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46501/solr
[junit4] 2> 2535347 INFO (zkConnectionManagerCallback-10419-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2535349 INFO (zkConnectionManagerCallback-10421-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2535354 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2535355 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2535357 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2535357 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34837_solr
[junit4] 2> 2535357 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2535357 INFO (zkCallback-10397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2535357 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2535357 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2535358 INFO (zkCallback-10420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2535358 INFO (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2536561 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34837.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2536570 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34837.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2536570 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34837.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2536572 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/tempDir-001/node3/.
[junit4] 2> 2536576 INFO (zkConnectionManagerCallback-10428-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2536577 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2536578 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:34837_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46501/solr ready
[junit4] 2> 2541617 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2541618 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2541618 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2541618 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2541618 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72a4ba{/solr,null,AVAILABLE}
[junit4] 2> 2541619 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@15c4bae{SSL,[ssl, http/1.1]}{127.0.0.1:37869}
[junit4] 2> 2541619 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server Started @2541649ms
[junit4] 2> 2541619 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37869}
[junit4] 2> 2541620 ERROR (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2541620 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2541620 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 2541620 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2541620 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2541620 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-26T05:45:20.132Z
[junit4] 2> 2541621 INFO (zkConnectionManagerCallback-10430-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2541623 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2541633 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46501/solr
[junit4] 2> 2541635 INFO (zkConnectionManagerCallback-10434-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2541637 INFO (zkConnectionManagerCallback-10436-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2541642 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2541643 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2541644 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2541644 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37869_solr
[junit4] 2> 2541645 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2541645 INFO (zkCallback-10397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2541645 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2541645 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2541645 INFO (zkCallback-10420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2541645 INFO (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2541645 INFO (zkCallback-10427-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2541645 INFO (zkCallback-10435-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2542338 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37869.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2542347 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37869.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2542347 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37869.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2542349 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/tempDir-001/node4/.
[junit4] 2> 2542352 INFO (zkConnectionManagerCallback-10443-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2542353 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2542354 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:37869_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46501/solr ready
[junit4] 2> 2542398 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@15c4bae{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2542398 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=13192802
[junit4] 2> 2542399 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2542399 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18e1569: rootName = solr_37869, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1155a74
[junit4] 2> 2542405 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2542405 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@498261: rootName = solr_37869, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a2fd75
[junit4] 2> 2542408 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2542408 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7e5322: rootName = solr_37869, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@152898d
[junit4] 2> 2542410 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37869_solr
[junit4] 2> 2542411 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2542411 INFO (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10427-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10442-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542411 INFO (zkCallback-10435-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2542412 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@72a4ba{/solr,null,UNAVAILABLE}
[junit4] 2> 2542412 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2547414 INFO (TEST-NodeAddedTriggerTest.testTrigger-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger
[junit4] 2> 2547446 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRestoreState
[junit4] 2> 2547447 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2547450 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2547450 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2547450 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2547450 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@409bc2{/solr,null,AVAILABLE}
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@244293{SSL,[ssl, http/1.1]}{127.0.0.1:45911}
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server Started @2547481ms
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45911}
[junit4] 2> 2547451 ERROR (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2547451 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-26T05:45:25.963Z
[junit4] 2> 2547453 INFO (zkConnectionManagerCallback-10445-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2547453 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2547463 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46501/solr
[junit4] 2> 2547464 INFO (zkConnectionManagerCallback-10449-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2547466 INFO (zkConnectionManagerCallback-10451-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2547470 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2547472 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2547473 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2547473 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45911_solr
[junit4] 2> 2547474 INFO (zkCallback-10397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2547474 INFO (zkCallback-10427-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2547474 INFO (zkCallback-10420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2547474 INFO (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2547474 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2547474 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2547474 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2547474 INFO (zkCallback-10450-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2551559 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45911.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2551567 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45911.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2551567 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45911.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2551568 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/tempDir-001/node5/.
[junit4] 2> 2551572 INFO (zkConnectionManagerCallback-10458-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2551573 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2551575 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:45911_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46501/solr ready
[junit4] 2> 2551617 INFO (TEST-NodeAddedTriggerTest.testRestoreState-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testRestoreState
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=NodeAddedTriggerTest -Dtests.method=testRestoreState -Dtests.seed=CCCBF8AE1E1EF137 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=bg -Dtests.timezone=Etc/GMT-6 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 4.21s J1 | NodeAddedTriggerTest.testRestoreState <<<
[junit4] > Throwable #1: java.lang.AssertionError: Did not expect the processor to fire on first run! event={
[junit4] > "id":"7f47f11889b16T2qygrv69br349kp1up7n8u91u",
[junit4] > "source":"node_added_trigger",
[junit4] > "eventTime":2239151429163798,
[junit4] > "eventType":"NODEADDED",
[junit4] > "properties":{
[junit4] > "eventTimes":[
[junit4] > 2239151429163798,
[junit4] > 2239151429166188,
[junit4] > 2239151429166744],
[junit4] > "nodeNames":[
[junit4] > "127.0.0.1:38799_solr",
[junit4] > "127.0.0.1:39837_solr",
[junit4] > "127.0.0.1:34837_solr"]}}
[junit4] > at __randomizedtesting.SeedInfo.seed([CCCBF8AE1E1EF137:2655C3DE6278921]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.lambda$new$0(NodeAddedTriggerTest.java:49)
[junit4] > at org.apache.solr.cloud.autoscaling.NodeAddedTrigger.run(NodeAddedTrigger.java:161)
[junit4] > at org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState(NodeAddedTriggerTest.java:257)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2551654 INFO (TEST-NodeAddedTriggerTest.testActionLifecycle-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testActionLifecycle
[junit4] 2> 2551656 INFO (TEST-NodeAddedTriggerTest.testActionLifecycle-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testActionLifecycle
[junit4] 2> 2551691 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testListenerAcceptance
[junit4] 2> 2551694 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T11:27:37-10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2551694 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2551694 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2551694 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2551695 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1411fb6{/solr,null,AVAILABLE}
[junit4] 2> 2551695 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@10ae5d0{SSL,[ssl, http/1.1]}{127.0.0.1:38609}
[junit4] 2> 2551695 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.e.j.s.Server Started @2551725ms
[junit4] 2> 2551695 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38609}
[junit4] 2> 2551696 ERROR (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2551696 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2551696 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 2551696 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2551696 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2551696 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-26T05:45:30.208Z
[junit4] 2> 2551697 INFO (zkConnectionManagerCallback-10460-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2551698 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2551708 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46501/solr
[junit4] 2> 2551709 INFO (zkConnectionManagerCallback-10464-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2551711 INFO (zkConnectionManagerCallback-10466-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2551717 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2551718 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2551719 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2551719 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38609_solr
[junit4] 2> 2551720 INFO (zkCallback-10397-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10427-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10450-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551720 INFO (zkCallback-10465-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2551721 INFO (zkCallback-10457-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2552783 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38609.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2552792 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38609.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2552792 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38609.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8f25
[junit4] 2> 2552793 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001/tempDir-001/node6/.
[junit4] 2> 2552797 INFO (zkConnectionManagerCallback-10473-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2552798 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 2552799 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [n:127.0.0.1:38609_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46501/solr ready
[junit4] 2> 2552849 INFO (TEST-NodeAddedTriggerTest.testListenerAcceptance-seed#[CCCBF8AE1E1EF137]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testListenerAcceptance
[junit4] 2> 2552851 INFO (jetty-closer-10374-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1c8e3a6{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2552852 INFO (jetty-closer-10374-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7f2af4{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2552852 INFO (jetty-closer-10374-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@dfaf83{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2552852 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=30070507
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=27487610
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=3641805
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-5) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@244293{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7b3ad2: rootName = solr_39837, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@b536dd
[junit4] 2> 2552854 INFO (jetty-closer-10374-thread-4) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@10ae5d0{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2552854 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c907f4: rootName = solr_34837, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@66b50a
[junit4] 2> 2552853 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1443d37: rootName = solr_38799, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ae91e5
[junit4] 2> 2552855 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=19662608
[junit4] 2> 2552855 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2552855 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b5b98: rootName = solr_38609, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1382659
[junit4] 2> 2552854 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=10068813
[junit4] 2> 2552857 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2552857 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6cf72a: rootName = solr_45911, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@a5fb6a
[junit4] 2> 2552862 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2552862 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1bd8593: rootName = solr_34837, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a2fd75
[junit4] 2> 2552862 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2552862 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a0ac27: rootName = solr_38799, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a2fd75
[junit4] 2> 2552864 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2552864 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7e7297: rootName = solr_39837, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a2fd75
[junit4] 2> 2552865 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2552865 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@783893: rootName = solr_38609, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a2fd75
[junit4] 2> 2552865 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2552865 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a1d998: rootName = solr_45911, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a2fd75
[junit4] 2> 2552866 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2552866 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e799e5: rootName = solr_34837, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@152898d
[junit4] 2> 2552866 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2552866 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@66958c: rootName = solr_38799, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@152898d
[junit4] 2> 2552867 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34837_solr
[junit4] 2> 2552867 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38799_solr
[junit4] 2> 2552868 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2552868 INFO (jetty-closer-10374-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2552868 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2552868 INFO (zkCallback-10420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552868 INFO (zkCallback-10427-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552868 INFO (zkCallback-10390-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552868 INFO (zkCallback-10465-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552868 INFO (zkCallback-10450-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552868 INFO (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552869 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552869 INFO (zkCallback-10383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552869 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2552869 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ed3aad: rootName = solr_39837, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@152898d
[junit4] 2> 2552870 INFO (jetty-closer-10374-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72204338003705859-127.0.0.1:38799_solr-n_0000000000) closing
[junit4] 2> 2552870 INFO (OverseerStateUpdate-72204338003705859-127.0.0.1:38799_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38799_solr
[junit4] 2> 2552870 WARN (OverseerAutoScalingTriggerThread-72204338003705859-127.0.0.1:38799_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2552870 INFO (zkCallback-10472-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552870 INFO (zkCallback-10457-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 2552870 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2552871 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f5798e: rootName = solr_45911, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@152898d
[junit4] 2> 2552871 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2552871 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@72a00: rootName = solr_38609, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@152898d
[junit4] 2> 2552872 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39837_solr
[junit4] 2> 2552873 INFO (jetty-closer-10374-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4ae9c7{/solr,null,UNAVAILABLE}
[junit4] 2> 2552873 INFO (jetty-closer-10374-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2552873 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:45911_solr
[junit4] 2> 2552874 INFO (jetty-closer-10374-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e0b28{/solr,null,UNAVAILABLE}
[junit4] 2> 2552874 INFO (jetty-closer-10374-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2552874 INFO (jetty-closer-10374-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2552874 INFO (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2552874 INFO (zkCallback-10465-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2552875 INFO (zkCallback-10405-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39837_solr
[junit4] 2> 2552875 INFO (zkCallback-10450-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2552875 INFO (zkCallback-10457-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2552875 INFO (zkCallback-10405-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2552875 INFO (zkCallback-10472-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2552875 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38609_solr
[junit4] 2> 2552875 INFO (jetty-closer-10374-thread-5) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2552876 INFO (zkCallback-10465-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2552876 INFO (zkCallback-10457-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2552876 INFO (zkCallback-10472-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2552876 INFO (zkCallback-10450-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2552876 INFO (zkCallback-10405-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2552876 INFO (jetty-closer-10374-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2552876 INFO (zkCallback-10472-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2552877 INFO (zkCallback-10405-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2552877 INFO (zkCallback-10465-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2552878 INFO (jetty-closer-10374-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1411fb6{/solr,null,UNAVAILABLE}
[junit4] 2> 2552878 INFO (jetty-closer-10374-thread-4) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2554375 WARN (zkCallback-10412-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2554376 INFO (jetty-closer-10374-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1c4790a{/solr,null,UNAVAILABLE}
[junit4] 2> 2554376 INFO (jetty-closer-10374-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2554376 WARN (zkCallback-10450-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2554377 INFO (jetty-closer-10374-thread-5) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@409bc2{/solr,null,UNAVAILABLE}
[junit4] 2> 2554377 INFO (jetty-closer-10374-thread-5) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2554377 ERROR (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2554377 INFO (SUITE-NodeAddedTriggerTest-seed#[CCCBF8AE1E1EF137]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46501 46501
[junit4] 2> 2554501 INFO (Thread-9058) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46501 46501
[junit4] 2> 2554503 WARN (Thread-9058) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/clusterstate.json
[junit4] 2> 13 /solr/clusterprops.json
[junit4] 2> 3 /solr/overseer_elect/election/72204338003705865-127.0.0.1:39837_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/72204338003705869-127.0.0.1:34837_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/live_nodes
[junit4] 2> 13 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.NodeAddedTriggerTest_CCCBF8AE1E1EF137-001
[junit4] 2> Apr 26, 2018 5:45:33 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1006, maxMBSortInHeap=5.322677884039007, sim=RandomSimilarity(queryNorm=true): {}, locale=bg, timezone=Etc/GMT-6
[junit4] 2> NOTE: Linux 4.13.0-37-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=159774304,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestManagedSynonymGraphFilterFactory, TestSurroundQueryParser, TestCorePropertiesReload, TestLegacyNumericRangeQueryBuilder, TestLeaderInitiatedRecoveryThread, SuggesterTest, TestElisionMultitermQuery, TestPointFields, TestFreeTextSuggestions, DistributedDebugComponentTest, SchemaVersionSpecificBehaviorTest, QueryResultKeyTest, PropertiesRequestHandlerTest, LIROnShardRestartTest, HdfsNNFailoverTest, TestCollectionsAPIViaSolrCloudCluster, SimplePostToolTest, UtilsToolTest, CachingDirectoryFactoryTest, TestZkChroot, JvmMetricsTest, TestLRUCache, TestRawResponseWriter, TestSolrJ, GraphQueryTest, TestInitParams, HdfsTlogReplayBufferedWhileIndexingTest, UpdateRequestProcessorFactoryTest, IndexSizeTriggerTest, RemoteQueryErrorTest, TestFieldTypeResource, TestOnReconnectListenerSupport, QueryEqualityTest, SyncSliceTest, TestAuthorizationFramework, TestManagedResourceStorage, TestReversedWildcardFilterFactory, TestReplicaProperties, TestPartialUpdateDeduplication, TestFoldingMultitermQuery, DistributedMLTComponentTest, DirectoryFactoryTest, HighlighterMaxOffsetTest, SortByFunctionTest, FieldMutatingUpdateProcessorTest, BasicFunctionalityTest, ZkControllerTest, NodeLostTriggerTest, TestSha256AuthenticationProvider, TestRecovery, DirectUpdateHandlerOptimizeTest, DistributedQueueTest, TestLegacyField, CursorMarkTest, TestPolicyCloud, BasicZkTest, ActionThrottleTest, TestDistributedGrouping, StressHdfsTest, TestConfigsApi, TestManagedSchema, ParsingFieldUpdateProcessorsTest, TestJsonFacets, ResponseHeaderTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestBlobHandler, TriLevelCompositeIdRoutingTest, TestXmlQParserPlugin, SampleTest, TemplateUpdateProcessorTest, HdfsRestartWhileUpdatingTest, AssignBackwardCompatibilityTest, TriggerSetPropertiesIntegrationTest, TestRestoreCore, ConcurrentDeleteAndCreateCollectionTest, SolrShardReporterTest, TestFieldCollectionResource, SolrCoreTest, ResourceLoaderTest, TestLuceneIndexBackCompat, TestReplicationHandler, TestRecoveryHdfs, TestSimpleTrackingShardHandler, SpatialHeatmapFacetsTest, TestPullReplicaErrorHandling, SpatialRPTFieldTypeTest, TestStressLiveNodes, HLLUtilTest, JSONWriterTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestTolerantUpdateProcessorRandomCloud, PrimUtilsTest, SoftAutoCommitTest, TestSolrIndexConfig, TestScoreJoinQPNoScore, TestConfigSetImmutable, TestConfigSetsAPIZkFailure, UninvertDocValuesMergePolicyTest, TestHdfsBackupRestoreCore, NodeAddedTriggerIntegrationTest, TestFuzzyAnalyzedSuggestions, TestPerFieldSimilarity, TestUninvertingReader, TestRTGBase, TestSweetSpotSimilarityFactory, ConnectionManagerTest, TestDistributedStatsComponentCardinality, ChaosMonkeySafeLeaderTest, DistributedFacetPivotSmallTest, TestSolrQueryResponse, SOLR749Test, TestSkipOverseerOperations, TestAnalyzeInfixSuggestions, TestClusterProperties, MoveReplicaHDFSFailoverTest, TestSolrXml, TestUniqueKeyFieldResource, DOMUtilTest, DocValuesMissingTest, TestSearchPerf, ExplicitHLLTest, ClassificationUpdateProcessorFactoryTest, PolyFieldTest, QueryParsingTest, OverseerTest, DistributedQueryComponentOptimizationTest, SolrMetricManagerTest, SolrJmxReporterTest, HdfsBasicDistributedZkTest, TestStressUserVersions, TolerantUpdateProcessorTest, SuggesterFSTTest, TestSolr4Spatial, PeerSyncTest, DirectUpdateHandlerTest, TestIndexSearcher, HighlighterTest, DistributedQueryElevationComponentTest, TestCoreDiscovery, TestStressLucene, TestTrie, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, XsltUpdateRequestHandlerTest, TestQueryUtils, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, TestValueSourceCache, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, TestCollationField, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, SearchHandlerTest, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, CopyFieldTest, BadComponentTest, TestStressRecovery, TestCharFilters, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestBM25SimilarityFactory, URLClassifyProcessorTest, TestFastLRUCache, TestSystemIdResolver, SpellingQueryConverterTest, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, DistributedIntervalFacetingTest, TestTolerantSearch, TokenizerChainTest, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, AddReplicaTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CloudExitableDirectoryReaderTest, CollectionsAPISolrJTest, DeleteShardTest, DistribJoinFromCollectionTest, DistributedVersionInfoTest, HttpPartitionOnCommitTest, HttpPartitionTest, MoveReplicaTest, MultiThreadedOCPTest, ReplicationFactorTest, TestCloudDeleteByQuery, TestCloudPivotFacet, TestCloudPseudoReturnFields, TestCryptoKeys, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestRandomRequestDistribution, TestSegmentSorting, TestStressCloudBlindAtomicUpdates, CollectionTooManyReplicasTest, CollectionsAPIDistributedZkTest, TestRequestStatusCollectionAPI, AutoAddReplicasPlanActionTest, ExecutePlanActionTest, NodeAddedTriggerTest]
[junit4] Completed [603/803 (1!)] on J1 in 24.05s, 4 tests, 1 failure <<< FAILURES!
[...truncated 46845 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/28/consoleText
[repro] Revision: c1865dfea816aa0a31c9d0aee131fe3ac7ac77c9
[repro] Repro line: ant test -Dtestcase=NodeAddedTriggerTest -Dtests.method=testRestoreState -Dtests.seed=CCCBF8AE1E1EF137 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=bg -Dtests.timezone=Etc/GMT-6 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] NodeAddedTriggerTest
[repro] ant compile-test
[...truncated 3316 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.NodeAddedTriggerTest" -Dtests.showOutput=onerror -Dtests.seed=CCCBF8AE1E1EF137 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=bg -Dtests.timezone=Etc/GMT-6 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 86 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest
[repro] Exiting with code 0
[...truncated 40 lines...]
[JENKINS] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk1.8.0_162) -
Build # 27 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/27/
Java: 64bit/jdk1.8.0_162 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger
Error Message:
waitFor not elapsed but produced an event
Stack Trace:
java.lang.AssertionError: waitFor not elapsed but produced an event
at __randomizedtesting.SeedInfo.seed([B2B44DDF02D94A2E:D17F7B5D9B163903]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger(IndexSizeTriggerTest.java:180)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13691 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_B2B44DDF02D94A2E-001/init-core-data-001
[junit4] 2> 1360105 INFO (SUITE-IndexSizeTriggerTest-seed#[B2B44DDF02D94A2E]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_B2B44DDF02D94A2E-001/tempDir-001
[junit4] 2> 1360105 INFO (SUITE-IndexSizeTriggerTest-seed#[B2B44DDF02D94A2E]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1360105 INFO (Thread-3671) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1360105 INFO (Thread-3671) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1360106 ERROR (Thread-3671) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1360205 INFO (SUITE-IndexSizeTriggerTest-seed#[B2B44DDF02D94A2E]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34257
[junit4] 2> 1360207 INFO (zkConnectionManagerCallback-3034-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360211 INFO (jetty-launcher-3031-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1360213 INFO (jetty-launcher-3031-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1360232 INFO (jetty-launcher-3031-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1360232 INFO (jetty-launcher-3031-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1360232 INFO (jetty-launcher-3031-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1360232 INFO (jetty-launcher-3031-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1360232 INFO (jetty-launcher-3031-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1360232 INFO (jetty-launcher-3031-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a1e8133{/solr,null,AVAILABLE}
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a63a0e{/solr,null,AVAILABLE}
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@e4d9dec{SSL,[ssl, http/1.1]}{127.0.0.1:34423}
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-2) [ ] o.e.j.s.Server Started @1360270ms
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@47871da3{SSL,[ssl, http/1.1]}{127.0.0.1:40133}
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34423}
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-1) [ ] o.e.j.s.Server Started @1360270ms
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40133}
[junit4] 2> 1360233 ERROR (jetty-launcher-3031-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1360233 ERROR (jetty-launcher-3031-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1360233 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-24T06:29:16.667Z
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1360234 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-24T06:29:16.667Z
[junit4] 2> 1360235 INFO (zkConnectionManagerCallback-3036-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360235 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1360236 INFO (zkConnectionManagerCallback-3038-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360237 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1360245 INFO (jetty-launcher-3031-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34257/solr
[junit4] 2> 1360245 INFO (jetty-launcher-3031-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34257/solr
[junit4] 2> 1360256 INFO (zkConnectionManagerCallback-3045-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360260 INFO (zkConnectionManagerCallback-3046-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360268 INFO (zkConnectionManagerCallback-3048-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360268 INFO (zkConnectionManagerCallback-3050-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360311 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1360311 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1360312 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34423_solr
[junit4] 2> 1360312 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40133_solr
[junit4] 2> 1360313 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.Overseer Overseer (id=72193186842869765-127.0.0.1:34423_solr-n_0000000000) starting
[junit4] 2> 1360313 INFO (zkCallback-3049-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1360313 INFO (zkCallback-3047-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1360320 INFO (zkConnectionManagerCallback-3059-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360321 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1360321 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34257/solr ready
[junit4] 2> 1360328 DEBUG (OverseerAutoScalingTriggerThread-72193186842869765-127.0.0.1:34423_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1360329 DEBUG (OverseerAutoScalingTriggerThread-72193186842869765-127.0.0.1:34423_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1360329 DEBUG (OverseerAutoScalingTriggerThread-72193186842869765-127.0.0.1:34423_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 1360329 DEBUG (OverseerAutoScalingTriggerThread-72193186842869765-127.0.0.1:34423_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1360330 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1360330 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34423_solr
[junit4] 2> 1360330 INFO (zkCallback-3047-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1360330 INFO (zkCallback-3049-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1360333 INFO (zkCallback-3058-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1360346 DEBUG (OverseerAutoScalingTriggerThread-72193186842869765-127.0.0.1:34423_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:34423_solr, 127.0.0.1:40133_solr]
[junit4] 2> 1360347 DEBUG (OverseerAutoScalingTriggerThread-72193186842869765-127.0.0.1:34423_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1360347 DEBUG (OverseerAutoScalingTriggerThread-72193186842869765-127.0.0.1:34423_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1360347 DEBUG (ScheduledTrigger-5946-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360434 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40133.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@394a8bea
[junit4] 2> 1360442 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40133.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@394a8bea
[junit4] 2> 1360442 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40133.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@394a8bea
[junit4] 2> 1360443 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_B2B44DDF02D94A2E-001/tempDir-001/node1/.
[junit4] 2> 1360456 INFO (zkConnectionManagerCallback-3064-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360457 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1360458 INFO (jetty-launcher-3031-thread-1) [n:127.0.0.1:40133_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34257/solr ready
[junit4] 2> 1360488 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34423.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@394a8bea
[junit4] 2> 1360495 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34423.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@394a8bea
[junit4] 2> 1360496 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34423.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@394a8bea
[junit4] 2> 1360497 INFO (jetty-launcher-3031-thread-2) [n:127.0.0.1:34423_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_B2B44DDF02D94A2E-001/tempDir-001/node2/.
[junit4] 2> 1360518 INFO (zkConnectionManagerCallback-3066-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360520 INFO (zkConnectionManagerCallback-3071-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1360521 INFO (SUITE-IndexSizeTriggerTest-seed#[B2B44DDF02D94A2E]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1360521 INFO (SUITE-IndexSizeTriggerTest-seed#[B2B44DDF02D94A2E]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34257/solr ready
[junit4] 2> 1360523 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1360524 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 1360524 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 1360524 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 1360524 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr]
[junit4] 2> 1360528 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1360528 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
[junit4] 2> 1360528 DEBUG (ScheduledTrigger-5955-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360549 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360569 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360589 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360610 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360630 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360650 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360670 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360690 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360711 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360731 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360752 DEBUG (ScheduledTrigger-5955-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360772 DEBUG (ScheduledTrigger-5955-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360792 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360809 DEBUG (simCloudManagerPool-5954-thread-6) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 1360810 DEBUG (simCloudManagerPool-5954-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 1360813 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360833 DEBUG (ScheduledTrigger-5955-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360853 DEBUG (ScheduledTrigger-5955-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360873 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360893 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360913 DEBUG (ScheduledTrigger-5955-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360933 DEBUG (ScheduledTrigger-5955-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1360950 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[B2B44DDF02D94A2E]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testTrigger_collection]
[junit4] 2> DocCollection(testTrigger_collection//clusterstate.json/28)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testTrigger_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - update 26
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2>
[junit4] 2> 1360951 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[B2B44DDF02D94A2E]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1360951 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1360951 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1360951 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1360951 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=IndexSizeTriggerTest -Dtests.method=testTrigger -Dtests.seed=B2B44DDF02D94A2E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=be-BY -Dtests.timezone=Africa/Ceuta -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 0.33s J1 | IndexSizeTriggerTest.testTrigger <<<
[junit4] > Throwable #1: java.lang.AssertionError: waitFor not elapsed but produced an event
[junit4] > at __randomizedtesting.SeedInfo.seed([B2B44DDF02D94A2E:D17F7B5D9B163903]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger(IndexSizeTriggerTest.java:180)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1361066 WARN (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[B2B44DDF02D94A2E]) [ ] o.a.s.c.a.IndexSizeTriggerTest Requires SOLR-12208
[junit4] 2> 1361066 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[B2B44DDF02D94A2E]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 2
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: []
[junit4] 2> ## Max replicas per node: 0
[junit4] 2> ## Min replicas per node: 0
[junit4] 2> ## Total replicas: 0
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2>
[junit4] 2> 1361066 DEBUG (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[B2B44DDF02D94A2E]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1361066 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1361066 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361066 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361066 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1361229 DEBUG (simCloudManagerPool-5954-thread-39) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testMergeIntegration_collection"}}
[junit4] 2> 1361229 DEBUG (simCloudManagerPool-5954-thread-40) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testMergeIntegration_collection"}}
[junit4] 2> 1361243 DEBUG (simCloudManagerPool-5954-thread-52) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1361243 DEBUG (simCloudManagerPool-5954-thread-52) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 1361243 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 1361243 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361243 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361243 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 1361245 DEBUG (simCloudManagerPool-5954-thread-53) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1361245 DEBUG (simCloudManagerPool-5954-thread-53) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 1361245 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 1361245 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361245 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361245 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 1361246 DEBUG (simCloudManagerPool-5954-thread-54) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1361246 DEBUG (simCloudManagerPool-5954-thread-54) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 1361246 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 1361246 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361246 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361246 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 1361348 DEBUG (ScheduledTrigger-5946-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1361388 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}
[junit4] 2> 1361388 DEBUG (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger]
[junit4] 2> 1361389 INFO (ScheduledTrigger-5955-thread-3) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089133945060607, stage=STARTED, actionName='null', event={
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361390 DEBUG (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}
[junit4] 2> 1361391 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089134031305157, stage=BEFORE_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361391 DEBUG (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 1361394 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed plan empty, remained 0 requested ops to try.
[junit4] 2> 1361394 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2089134191 sessionWrapper.createTime 2089134089157057, this.sessionWrapper.createTime 2089134089157057
[junit4] 2> 1361394 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089134195279657, stage=AFTER_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":1,
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard2"}, {
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard1"}]}}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361395 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089134213946257, stage=BEFORE_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":1,
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard2"}, {
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard1"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361395 DEBUG (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":1,
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} with context properties: {AFTER_ACTION=[compute_plan], unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard2"}, {
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard1"}]}}], BEFORE_ACTION=[compute_plan, execute_plan]}
[junit4] 2> 1361395 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ExecutePlanAction No operations to execute for event: {
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":1,
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}
[junit4] 2> 1361395 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089134244254557, stage=AFTER_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":1,
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard2"}, {
[junit4] 2> "first":"testMergeIntegration_collection",
[junit4] 2> "second":"shard1"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361396 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089134263164757, stage=SUCCEEDED, actionName='null', event={
[junit4] 2> "id":"76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089126663015007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":1,
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":2089133904253657,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361396 DEBUG (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: index_size_trigger after 100ms
[junit4] 2> 1361396 DEBUG (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 313 ms for event id=76c0cb4a3ca5fTdy4i2toxup216mc5vvz27y74j
[junit4] 2> 1361398 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[B2B44DDF02D94A2E]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testMergeIntegration_collection]
[junit4] 2> DocCollection(testMergeIntegration_collection//clusterstate.json/49)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":3,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":3},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":3,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":3}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":5,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":2},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":5,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":2}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testMergeIntegration_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - autoscaling 3
[junit4] 2> ## - update 19
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2> ## * Trigger: index_size_trigger
[junit4] 2> ## - STARTED 1
[junit4] 2> ## - SUCCEEDED 1
[junit4] 2>
[junit4] 2> 1361398 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[B2B44DDF02D94A2E]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 1361398 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 1361399 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361399 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361399 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 1361562 DEBUG (simCloudManagerPool-5954-thread-68) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1361563 DEBUG (simCloudManagerPool-5954-thread-69) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1361573 DEBUG (simCloudManagerPool-5954-thread-70) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1361573 DEBUG (simCloudManagerPool-5954-thread-70) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 1361573 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 1361573 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361573 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361573 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 1361574 DEBUG (simCloudManagerPool-5954-thread-71) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1361574 DEBUG (simCloudManagerPool-5954-thread-71) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 1361574 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 1361574 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361574 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361574 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 1361574 DEBUG (simCloudManagerPool-5954-thread-72) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1361574 DEBUG (simCloudManagerPool-5954-thread-72) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 1361574 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
[junit4] 2> 1361574 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1361575 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1361575 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 1361696 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"76c108c6c5107Tdy4i2toxup216mc5vvz27y74m",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089143168160007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 1361696 DEBUG (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger]
[junit4] 2> 1361696 INFO (ScheduledTrigger-5955-thread-4) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089149282479607, stage=STARTED, actionName='null', event={
[junit4] 2> "id":"76c108c6c5107Tdy4i2toxup216mc5vvz27y74m",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089143168160007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2089149277203857,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361697 DEBUG (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"76c108c6c5107Tdy4i2toxup216mc5vvz27y74m",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089143168160007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2089149277203857,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 1361697 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089149352428657, stage=BEFORE_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"76c108c6c5107Tdy4i2toxup216mc5vvz27y74m",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089143168160007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2089149277203857,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361698 DEBUG (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"76c108c6c5107Tdy4i2toxup216mc5vvz27y74m",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089143168160007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2089149277203857,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 1361698 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
[junit4] 2> 1361698 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2
[junit4] 2> 1361698 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2089149398 sessionWrapper.createTime 2089149380508857, this.sessionWrapper.createTime 2089149380508857
[junit4] 2> 1361698 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089149399351557, stage=AFTER_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"76c108c6c5107Tdy4i2toxup216mc5vvz27y74m",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089143168160007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2089149277203857,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1361699 INFO (AutoscalingActionExecutor-5956-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2089149414895357, stage=BEFORE_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"76c108c6c5107Tdy4i2toxup216mc5vvz27y74m",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":2089143168160007,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2089149277203857,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.Coll
[...truncated too long message...]
orters.SolrJmxReporter@7b117c84: rootName = solr_33731, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@682665f7
[junit4] 2> 7373 INFO (jetty-closer-2-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33731_solr
[junit4] 2> 7373 INFO (jetty-closer-2-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35291_solr
[junit4] 2> 7374 INFO (jetty-closer-2-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 7374 INFO (jetty-closer-2-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 7374 INFO (zkCallback-28-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 7374 INFO (zkCallback-17-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 7374 INFO (jetty-closer-2-thread-2) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 7375 INFO (zkCallback-33-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 7375 INFO (zkCallback-19-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 7376 INFO (jetty-closer-2-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72193357286146054-127.0.0.1:35291_solr-n_0000000000) closing
[junit4] 2> 7376 WARN (OverseerAutoScalingTriggerThread-72193357286146054-127.0.0.1:35291_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 7377 DEBUG (jetty-closer-2-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 7376 INFO (OverseerStateUpdate-72193357286146054-127.0.0.1:35291_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35291_solr
[junit4] 2> 7377 DEBUG (jetty-closer-2-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 7377 DEBUG (jetty-closer-2-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 7377 DEBUG (jetty-closer-2-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 7377 DEBUG (jetty-closer-2-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 7377 DEBUG (jetty-closer-2-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 7378 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007b79d82f0007, likely client has closed socket
[junit4] 2> 7380 INFO (jetty-closer-2-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@68800c49{/solr,null,UNAVAILABLE}
[junit4] 2> 7380 INFO (jetty-closer-2-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@e7518d0{/solr,null,UNAVAILABLE}
[junit4] 2> 7380 INFO (jetty-closer-2-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 7380 INFO (jetty-closer-2-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 7381 ERROR (SUITE-IndexSizeTriggerTest-seed#[B2B44DDF02D94A2E]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 7382 INFO (SUITE-IndexSizeTriggerTest-seed#[B2B44DDF02D94A2E]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39351 39351
[junit4] 2> 7488 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39351 39351
[junit4] 2> 7489 WARN (Thread-1) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_B2B44DDF02D94A2E-001
[junit4] 2> Apr 24, 2018 7:12:41 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=393, maxMBSortInHeap=7.932961998253219, sim=RandomSimilarity(queryNorm=true): {}, locale=be-BY, timezone=Africa/Ceuta
[junit4] 2> NOTE: Linux 4.13.0-37-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=432715992,total=501743616
[junit4] 2> NOTE: All tests run in this JVM: [IndexSizeTriggerTest]
[junit4] Completed [1/5 (1!)] on J2 in 7.65s, 4 tests, 1 failure, 1 error <<< FAILURES!
[junit4]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] OK 0.36s J0 | IndexSizeTriggerTest.testTrigger
[junit4] OK 0.11s J0 | IndexSizeTriggerTest.testMixedBounds
[junit4] OK 0.38s J0 | IndexSizeTriggerTest.testMergeIntegration
[junit4] OK 0.65s J0 | IndexSizeTriggerTest.testSplitIntegration
[junit4] Completed [2/5 (1!)] on J0 in 8.59s, 4 tests
[junit4]
[junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] OK 0.41s J1 | IndexSizeTriggerTest.testTrigger
[junit4] OK 0.12s J1 | IndexSizeTriggerTest.testMixedBounds
[junit4] OK 0.65s J1 | IndexSizeTriggerTest.testMergeIntegration
[junit4] OK 0.60s J1 | IndexSizeTriggerTest.testSplitIntegration
[junit4] Completed [3/5 (1!)] on J1 in 8.75s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] OK 0.32s J2 | IndexSizeTriggerTest.testTrigger
[junit4] OK 0.13s J2 | IndexSizeTriggerTest.testMixedBounds
[junit4] OK 0.33s J2 | IndexSizeTriggerTest.testMergeIntegration
[junit4] OK 0.59s J2 | IndexSizeTriggerTest.testSplitIntegration
[junit4] Completed [4/5 (1!)] on J2 in 2.65s, 4 tests
[junit4]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] OK 0.27s J0 | IndexSizeTriggerTest.testTrigger
[junit4] OK 0.11s J0 | IndexSizeTriggerTest.testMixedBounds
[junit4] OK 0.32s J0 | IndexSizeTriggerTest.testMergeIntegration
[junit4] OK 0.59s J0 | IndexSizeTriggerTest.testSplitIntegration
[junit4] Completed [5/5 (1!)] on J0 in 2.85s, 4 tests
[junit4]
[junit4]
[junit4] Tests with failures [seed: B2B44DDF02D94A2E]:
[junit4] - org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger
[junit4] - org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
[junit4]
[junit4]
[junit4] JVM J0: 0.49 .. 12.80 = 12.31s
[junit4] JVM J1: 0.50 .. 10.06 = 9.56s
[junit4] JVM J2: 0.48 .. 11.69 = 11.21s
[junit4] Execution time total: 13 seconds
[junit4] Tests summary: 5 suites, 20 tests, 1 error, 1 failure
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1568: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1092: There were test failures: 5 suites, 20 tests, 1 error, 1 failure [seed: B2B44DDF02D94A2E]
Total time: 14 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 1/5 failed: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=9e36c51e6575a8d750ddc62683c528df197f2833, workspace=/var/lib/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #26
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2