You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/07/08 16:09:09 UTC
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-11.0.6) - Build #
27257 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/27257/
Java: 64bit/jdk-11.0.6 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard
Error Message:
java.util.concurrent.TimeoutException: OverseerTriggerThread never caught up to the latest znodeVersion
Stack Trace:
java.lang.AssertionError: java.util.concurrent.TimeoutException: OverseerTriggerThread never caught up to the latest znodeVersion
at __randomizedtesting.SeedInfo.seed([650F2C6F0937DE68:BE05810317C2E2D7]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard(TestSimScenario.java:164)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
Build Log:
[...truncated 12561 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
[junit4] 2> 139803 INFO (SUITE-TestSimScenario-seed#[650F2C6F0937DE68]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/solr/configsets/_default/conf'
[junit4] 2> 139803 INFO (SUITE-TestSimScenario-seed#[650F2C6F0937DE68]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 139804 INFO (SUITE-TestSimScenario-seed#[650F2C6F0937DE68]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_650F2C6F0937DE68-001/data-dir-73-001
[junit4] 2> 139804 WARN (SUITE-TestSimScenario-seed#[650F2C6F0937DE68]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
[junit4] 2> 139804 INFO (SUITE-TestSimScenario-seed#[650F2C6F0937DE68]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 139804 INFO (SUITE-TestSimScenario-seed#[650F2C6F0937DE68]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 139805 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSuggestions
[junit4] 2> 139811 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 1. CreateCluster numNodes=2
[junit4] 2> 139811 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario CreateCluster numNodes=2
[junit4] 2> 139813 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.SolrPaths solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 139820 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 139820 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10000_solr
[junit4] 2> 139820 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 139821 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 139821 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 139821 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 139821 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 2. LoadAutoscaling json={'cluster-policy':[]}
[junit4] 2> 139821 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario LoadAutoscaling json={'cluster-policy':[]}
[junit4] 2> 139822 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 139822 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
[junit4] 2> 139822 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 139822 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
[junit4] 2> 139822 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 139823 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 139823 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 139823 DEBUG (ScheduledTrigger-2403-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139827 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 3. RunSolrRequest path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
[junit4] 2> 139827 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
[junit4] 2> 139828 DEBUG (simCloudManagerPool-2402-thread-1) [ ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection
[junit4] 2> 139843 DEBUG (ScheduledTrigger-2403-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139854 DEBUG (simCloudManagerPool-2402-thread-2) [ ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard1)
[junit4] 2> 139854 DEBUG (simCloudManagerPool-2402-thread-2) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard1 (currentVersion=2): {"core_node1":{
[junit4] 2> "core":"testCollection_shard1_replica_n1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 139863 DEBUG (ScheduledTrigger-2403-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139875 DEBUG (simCloudManagerPool-2402-thread-4) [ ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard2)
[junit4] 2> 139875 DEBUG (simCloudManagerPool-2402-thread-4) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard2 (currentVersion=4): {"core_node3":{
[junit4] 2> "core":"testCollection_shard2_replica_n3",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 139875 DEBUG (simCloudManagerPool-2402-thread-1) [ ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection
[junit4] 2> 139876 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 4. WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 139876 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 139883 DEBUG (ScheduledTrigger-2403-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139886 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 5. CtxSet key=myNode&value=${_random_node_}
[junit4] 2> 139886 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario CtxSet key=myNode&value=127.0.0.1:10000_solr
[junit4] 2> 139886 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 6. RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
[junit4] 2> 139886 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10000_solr
[junit4] 2> 139887 INFO (simCloudManagerPool-2402-thread-6) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10000_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 139887 INFO (simCloudManagerPool-2402-thread-6) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 139897 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 7. RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
[junit4] 2> 139897 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10000_solr
[junit4] 2> 139898 INFO (simCloudManagerPool-2402-thread-7) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10000_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 139898 INFO (simCloudManagerPool-2402-thread-7) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 139904 DEBUG (ScheduledTrigger-2403-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139908 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 8. LoopOp iterations=${iterative}
[junit4] 2> 139908 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario LoopOp iterations=0
[junit4] 2> 139908 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 9. LoopOp iterations=${justCalc}
[junit4] 2> 139908 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario LoopOp iterations=1
[junit4] 2> 139908 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 1 :
[junit4] 2> 139908 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 139913 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 139913 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - SaveSnapshot path=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_650F2C6F0937DE68-001/tempDir-001/snapshot/0)
[junit4] 2> 139916 WARN (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimUtils V2 action SET_CLUSTER_PROPERTY_OBJ has no equivalent V1 action
[junit4] 2> 139916 WARN (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimUtils V2 action GET_NODES has no equivalent V1 action
[junit4] 2> 139918 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from SimDistribStateManager
[junit4] 2> 139924 DEBUG (ScheduledTrigger-2403-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139926 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 10. Dump redact=true
[junit4] 2> 139926 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario Dump redact=true
[junit4] 2> 139927 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from SimDistribStateManager
[junit4] 2> 139930 INFO (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 139930 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 139930 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 139930 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 139930 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 139930 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 139930 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 139930 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 1. CreateCluster numNodes=2
[junit4] 2> 139930 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario CreateCluster numNodes=2
[junit4] 2> 139932 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10002_solr
[junit4] 2> 139932 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 139932 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 139932 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 2. LoadAutoscaling json={'cluster-policy':[]}
[junit4] 2> 139932 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario LoadAutoscaling json={'cluster-policy':[]}
[junit4] 2> 139932 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 139932 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 139932 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 139932 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 139933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
[junit4] 2> 139933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 139933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
[junit4] 2> 139933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 139933 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 3. RunSolrRequest path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
[junit4] 2> 139933 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139933 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
[junit4] 2> 139933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 139933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 139933 DEBUG (simCloudManagerPool-2408-thread-1) [ ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection
[junit4] 2> 139953 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139955 DEBUG (simCloudManagerPool-2408-thread-2) [ ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard1)
[junit4] 2> 139955 DEBUG (simCloudManagerPool-2408-thread-2) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard1 (currentVersion=2): {"core_node1":{
[junit4] 2> "core":"testCollection_shard1_replica_n1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 139973 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139975 DEBUG (simCloudManagerPool-2408-thread-4) [ ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard2)
[junit4] 2> 139975 DEBUG (simCloudManagerPool-2408-thread-4) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard2 (currentVersion=4): {"core_node3":{
[junit4] 2> "core":"testCollection_shard2_replica_n3",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 139975 DEBUG (simCloudManagerPool-2408-thread-1) [ ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection
[junit4] 2> 139975 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 4. WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 139975 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 139986 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 5. CtxSet key=myNode&value=${_random_node_}
[junit4] 2> 139986 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario CtxSet key=myNode&value=127.0.0.1:10002_solr
[junit4] 2> 139986 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 6. RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
[junit4] 2> 139986 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr
[junit4] 2> 139986 INFO (simCloudManagerPool-2408-thread-6) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 139986 INFO (simCloudManagerPool-2408-thread-6) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 139993 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 139997 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 7. RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
[junit4] 2> 139997 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr
[junit4] 2> 139997 INFO (simCloudManagerPool-2408-thread-7) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 139997 INFO (simCloudManagerPool-2408-thread-7) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140008 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 8. LoopOp iterations=${iterative}
[junit4] 2> 140008 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario LoopOp iterations=10
[junit4] 2> 140008 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 1 :
[junit4] 2> 140008 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 140009 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 140009 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 140013 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140034 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140054 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140074 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140094 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140110 DEBUG (simCloudManagerPool-2408-thread-8) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node10":{
[junit4] 2> "core":"testCollection_shard2_replica_n9",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 140114 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140134 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140154 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140175 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140195 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140215 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140221 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140221 INFO (simCloudManagerPool-2408-thread-9) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140222 INFO (simCloudManagerPool-2408-thread-9) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140232 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140232 INFO (simCloudManagerPool-2408-thread-10) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140233 INFO (simCloudManagerPool-2408-thread-10) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140235 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140243 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 2 :
[junit4] 2> 140243 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 140244 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 140244 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 140255 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140275 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140297 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140317 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140337 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140344 DEBUG (simCloudManagerPool-2408-thread-11) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node16":{
[junit4] 2> "core":"testCollection_shard1_replica_n15",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 140357 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140378 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140398 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140418 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140438 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140455 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140455 INFO (simCloudManagerPool-2408-thread-12) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140456 INFO (simCloudManagerPool-2408-thread-12) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140458 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140466 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140466 INFO (simCloudManagerPool-2408-thread-13) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140466 INFO (simCloudManagerPool-2408-thread-13) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140477 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 3 :
[junit4] 2> 140477 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 140478 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 140478 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 140478 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140499 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140519 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140539 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140559 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140578 DEBUG (simCloudManagerPool-2408-thread-14) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node22":{
[junit4] 2> "core":"testCollection_shard1_replica_n21",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 140579 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140599 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140619 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140639 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140659 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140680 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140689 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140689 INFO (simCloudManagerPool-2408-thread-15) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140689 INFO (simCloudManagerPool-2408-thread-15) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140700 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140700 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140701 INFO (simCloudManagerPool-2408-thread-16) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140701 INFO (simCloudManagerPool-2408-thread-16) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140711 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 4 :
[junit4] 2> 140711 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 140712 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 140712 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 140720 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140740 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140760 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140780 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140800 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140812 DEBUG (simCloudManagerPool-2408-thread-17) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node28":{
[junit4] 2> "core":"testCollection_shard1_replica_n27",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 140820 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140840 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140861 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140881 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140901 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140921 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140923 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140923 INFO (simCloudManagerPool-2408-thread-18) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140923 INFO (simCloudManagerPool-2408-thread-18) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140934 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 140934 INFO (simCloudManagerPool-2408-thread-19) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 140934 INFO (simCloudManagerPool-2408-thread-19) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 140941 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140945 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 5 :
[junit4] 2> 140945 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 140945 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 140945 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 140961 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 140981 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141001 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141021 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141042 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141046 DEBUG (simCloudManagerPool-2408-thread-20) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node34":{
[junit4] 2> "core":"testCollection_shard1_replica_n33",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 141062 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141082 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141102 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141122 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141142 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141157 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141157 INFO (simCloudManagerPool-2408-thread-21) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141157 INFO (simCloudManagerPool-2408-thread-21) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141162 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141168 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141168 INFO (simCloudManagerPool-2408-thread-22) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141168 INFO (simCloudManagerPool-2408-thread-22) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141179 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 6 :
[junit4] 2> 141179 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 141180 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 141180 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 141183 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141203 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141223 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141243 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141263 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141281 DEBUG (simCloudManagerPool-2408-thread-23) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node40":{
[junit4] 2> "core":"testCollection_shard1_replica_n39",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 141284 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141304 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141324 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141344 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141364 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141384 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141391 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141392 INFO (simCloudManagerPool-2408-thread-24) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141392 INFO (simCloudManagerPool-2408-thread-24) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141403 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141403 INFO (simCloudManagerPool-2408-thread-25) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141403 INFO (simCloudManagerPool-2408-thread-25) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141405 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141413 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 7 :
[junit4] 2> 141414 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 141414 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 141414 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 141425 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141445 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141465 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141485 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141506 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141515 DEBUG (simCloudManagerPool-2408-thread-26) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node46":{
[junit4] 2> "core":"testCollection_shard1_replica_n45",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 141526 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141546 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141566 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141586 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141607 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141626 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141626 INFO (simCloudManagerPool-2408-thread-27) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141626 INFO (simCloudManagerPool-2408-thread-27) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141627 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141637 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141638 INFO (simCloudManagerPool-2408-thread-28) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141638 INFO (simCloudManagerPool-2408-thread-28) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141647 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141649 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 8 :
[junit4] 2> 141649 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 141650 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 141650 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 141667 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141687 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141707 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141728 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141748 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141750 DEBUG (simCloudManagerPool-2408-thread-29) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node52":{
[junit4] 2> "core":"testCollection_shard1_replica_n51",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 141768 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141788 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141808 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141828 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141848 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141861 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141863 INFO (simCloudManagerPool-2408-thread-30) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141863 INFO (simCloudManagerPool-2408-thread-30) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141869 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141873 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 141874 INFO (simCloudManagerPool-2408-thread-31) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 141874 INFO (simCloudManagerPool-2408-thread-31) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 141884 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 9 :
[junit4] 2> 141884 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 141885 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 141885 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 141889 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141909 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141929 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141949 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141969 DEBUG (ScheduledTrigger-2409-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 141986 DEBUG (simCloudManagerPool-2408-thread-32) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node58":{
[junit4] 2> "core":"testCollection_shard1_replica_n57",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 141989 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142009 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142030 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142050 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142070 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142090 DEBUG (ScheduledTrigger-2409-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142096 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 142097 INFO (simCloudManagerPool-2408-thread-33) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 142097 INFO (simCloudManagerPool-2408-thread-33) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 142107 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 142108 INFO (simCloudManagerPool-2408-thread-34) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 142108 INFO (simCloudManagerPool-2408-thread-34) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 142110 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142119 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario * iter 10 :
[junit4] 2> 142119 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - CalculateSuggestions )
[junit4] 2> 142120 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - 1 suggestions
[junit4] 2> 142120 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - ApplySuggestions )
[junit4] 2> 142130 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142150 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142170 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142190 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142211 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142220 DEBUG (simCloudManagerPool-2408-thread-35) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node64":{
[junit4] 2> "core":"testCollection_shard1_replica_n63",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10003_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"127.0.0.1:10002_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"127.0.0.1:10002_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}
[junit4] 2> 142231 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142251 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142271 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142291 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142311 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142331 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 142331 DEBUG (ScheduledTrigger-2409-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142331 INFO (simCloudManagerPool-2408-thread-36) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 142332 INFO (simCloudManagerPool-2408-thread-36) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 142342 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario - RunSolrRequest path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
[junit4] 2> 142343 INFO (simCloudManagerPool-2408-thread-37) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new replica of shard shard1 for collection testCollection
[junit4] 2> 142343 INFO (simCloudManagerPool-2408-thread-37) [ ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 142352 DEBUG (ScheduledTrigger-2409-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 142353 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 9. LoopOp iterations=${justCalc}
[junit4] 2> 142353 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario LoopOp iterations=0
[junit4] 2> 142353 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 10. Dump redact=true
[junit4] 2> 142353 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario Dump redact=true
[junit4] 2> 142354 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from SimDistribStateManager
[junit4] 2> {"autoscalingState":{"suggestions":[{
[junit4] 2> "suggestion":{
[junit4] 2> "type":"improvement",
[junit4] 2> "operation":{
[junit4] 2> "method":"POST",
[junit4] 2> "path":"/c/COLL_0",
[junit4] 2> "command":{"move-replica":{
[junit4] 2> "targetNode":"N_1_solr",
[junit4] 2> "inPlaceMove":"true",
[junit4] 2> "replica":"core_node30"}}}},
[junit4] 2> "replica":{"core_node30":{
[junit4] 2> "core":"COLL_0_shard1_replica_n29",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"COLL_0",
[junit4] 2> "node_name":"N_2_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "path":"/admin/collections",
[junit4] 2> "node":"N_2_solr",
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "action":"ADDREPLICA",
[junit4] 2> "createNodeSet":"N_2_solr",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6}}}]}}
[junit4] 2> 142357 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 142357 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 142357 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 142357 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 142357 INFO (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 142357 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 142357 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 142358 INFO (TEST-TestSimScenario.testSuggestions-seed#[650F2C6F0937DE68]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSuggestions
[junit4] 2> 142359 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testIndexing
[junit4] 2> 142360 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 1. CreateCluster numNodes=100
[junit4] 2> 142360 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario CreateCluster numNodes=100
[junit4] 2> 142361 DEBUG (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10004_solr
[junit4] 2> 142361 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 142361 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 142361 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 142362 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 142362 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 142362 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10017_solr, 127.0.0.1:10012_solr, 127.0.0.1:10007_solr, 127.0.0.1:10015_solr, 127.0.0.1:10006_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10005_solr, 127.0.0.1:10009_solr, 127.0.0.1:10013_solr, 127.0.0.1:10008_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr]
[junit4] 2> 142362 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 142362 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 142362 DEBUG (ScheduledTrigger-2415-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 18 and last live nodes: 15
[junit4] 2> 142366 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 2. LoadAutoscaling json={'cluster-policy':[]}
[junit4] 2> 142366 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario LoadAutoscaling json={'cluster-policy':[]}
[junit4] 2> 142366 DEBUG (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 142367 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 142367 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 142367 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 142372 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 3. RunSolrRequest path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
[junit4] 2> 142372 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
[junit4] 2> 142372 DEBUG (simCloudManagerPool-2414-thread-1) [ ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection
[junit4] 2> 142382 DEBUG (ScheduledTrigger-2415-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 18
[junit4] 2> 142394 DEBUG (simCloudManagerPool-2414-thread-2) [ ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard1)
[junit4] 2> 142394 DEBUG (simCloudManagerPool-2414-thread-2) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard1 (currentVersion=2): {"core_node1":{
[junit4] 2> "core":"testCollection_shard1_replica_n1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10103_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 142403 DEBUG (ScheduledTrigger-2415-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
[junit4] 2> 142416 DEBUG (simCloudManagerPool-2414-thread-4) [ ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard2)
[junit4] 2> 142416 DEBUG (simCloudManagerPool-2414-thread-4) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard2 (currentVersion=4): {"core_node3":{
[junit4] 2> "core":"testCollection_shard2_replica_n3",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10081_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 142416 DEBUG (simCloudManagerPool-2414-thread-1) [ ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection
[junit4] 2> 142416 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 4. WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 142416 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 142423 DEBUG (ScheduledTrigger-2415-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
[junit4] 2> 142427 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 5. RunSolrRequest path=/admin/autoscaling&httpMethod=POST&stream.body={'set-trigger':{'name':'indexSizeTrigger','event':'indexSize','waitFor':'10s','aboveDocs':1000,'enabled':true,'actions':[{'name':'compute_plan','class':'solr.ComputePlanAction'},{'name':'execute_plan','class':'solr.ExecutePlanAction'}]}}
[junit4] 2> 142427 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSolrRequest path=/admin/autoscaling&httpMethod=POST&stream.body={'set-trigger':{'name':'indexSizeTrigger','event':'indexSize','waitFor':'10s','aboveDocs':1000,'enabled':true,'actions':[{'name':'compute_plan','class':'solr.ComputePlanAction'},{'name':'execute_plan','class':'solr.ExecutePlanAction'}]}}
[junit4] 2> 142431 DEBUG (simCloudManagerPool-2414-thread-6) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 142431 DEBUG (simCloudManagerPool-2414-thread-6) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 142431 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 142431 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 6. SetEventListener trigger=indexSizeTrigger&stage=SUCCEEDED
[junit4] 2> 142431 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario SetEventListener trigger=indexSizeTrigger&stage=SUCCEEDED
[junit4] 2> 142431 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 142431 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 142432 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 7. IndexDocs collection=testCollection&numDocs=3000
[junit4] 2> 142432 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario IndexDocs collection=testCollection&numDocs=3000
[junit4] 2> 142435 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 8. RunSimulator
[junit4] 2> 142435 INFO (TEST-TestSimScenario.testIndexing-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario RunSimulator
[junit4] 2> 142443 DEBUG (ScheduledTrigger-2415-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
[junit4] 2> 142463 DEBUG (ScheduledTrigger-2415-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
[junit4] 2> 142484 DEBUG (ScheduledTrigger-2415-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
[junit4] 2> 142504 DEBUG (ScheduledTrigger-2415-thread-2) [
[...truncated too long message...]
lan: action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10107_solr&inPlaceMove=true&replica=core_node3
[junit4] 2> 144516 DEBUG (AutoscalingActionExecutor-2428-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"898b1f9086db7T15yp1rrcwxyb7a23l1neslkfm",
[junit4] 2> "source":".auto_add_replicas",
[junit4] 2> "eventTime":2419689968397751,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[2419689968397751],
[junit4] 2> "preferredOperation":"movereplica",
[junit4] 2> "_enqueue_time_":2419700072486051,
[junit4] 2> "nodeNames":["127.0.0.1:10106_solr"]}} with context properties: {operations=[{
[junit4] 2> "class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica",
[junit4] 2> "method":"GET",
[junit4] 2> "params.action":"MOVEREPLICA",
[junit4] 2> "params.collection":"testCollection",
[junit4] 2> "params.targetNode":"127.0.0.1:10107_solr",
[junit4] 2> "params.inPlaceMove":"true",
[junit4] 2> "params.replica":"core_node2"}, {
[junit4] 2> "class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica",
[junit4] 2> "method":"GET",
[junit4] 2> "params.action":"MOVEREPLICA",
[junit4] 2> "params.collection":"testCollection",
[junit4] 2> "params.targetNode":"127.0.0.1:10107_solr",
[junit4] 2> "params.inPlaceMove":"true",
[junit4] 2> "params.replica":"core_node3"}], AFTER_ACTION=[auto_add_replicas_plan], BEFORE_ACTION=[auto_add_replicas_plan, execute_plan]}
[junit4] 2> 144516 DEBUG (AutoscalingActionExecutor-2428-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10107_solr&inPlaceMove=true&replica=core_node2
[junit4] 2> 144617 DEBUG (simCloudManagerPool-2426-thread-8) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node6":{
[junit4] 2> "core":"testCollection_shard1_replica_n5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10107_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"down",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 144729 DEBUG (AutoscalingActionExecutor-2428-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10107_solr&inPlaceMove=true&replica=core_node3
[junit4] 2> 144830 DEBUG (simCloudManagerPool-2426-thread-11) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node8":{
[junit4] 2> "core":"testCollection_shard2_replica_n7",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testCollection",
[junit4] 2> "node_name":"127.0.0.1:10107_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"down",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 144941 DEBUG (AutoscalingActionExecutor-2428-thread-1) [ ] o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
[junit4] 2> "id":"898b1f9086db7T15yp1rrcwxyb7a23l1neslkfm",
[junit4] 2> "source":".auto_add_replicas",
[junit4] 2> "eventTime":2419689968397751,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[2419689968397751],
[junit4] 2> "preferredOperation":"movereplica",
[junit4] 2> "_enqueue_time_":2419700072486051,
[junit4] 2> "nodeNames":["127.0.0.1:10106_solr"]}}
[junit4] 2> 144941 DEBUG (AutoscalingActionExecutor-2428-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
[junit4] 2> 144941 DEBUG (AutoscalingActionExecutor-2428-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
[junit4] 2> 144941 DEBUG (AutoscalingActionExecutor-2428-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 21293 ms for event id=898b1f9086db7T15yp1rrcwxyb7a23l1neslkfm
[junit4] 2> 144941 INFO (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 8. WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 144941 INFO (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario WaitCollection collection=testCollection&shards=2&replicas=2
[junit4] 2> 144941 INFO (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario 9. SaveSnapshot path=${snapshotPath}
[junit4] 2> 144941 INFO (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SimScenario SaveSnapshot path=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_650F2C6F0937DE68-001/tempDir-002/snapshot
[junit4] 2> 144942 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SnapshotDistribStateManager - copying 23 resources from SimDistribStateManager
[junit4] 2> 144944 INFO (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 144944 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 144945 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 144945 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 144945 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 144945 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 144945 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 144947 DEBUG (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.c.a.s.SnapshotDistribStateManager - loaded snapshot of 23 resources
[junit4] 2> 144948 INFO (TEST-TestSimScenario.testAutoAddReplicas-seed#[650F2C6F0937DE68]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testAutoAddReplicas
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_650F2C6F0937DE68-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {}, docValues:{}, maxPointsInLeafNode=1551, maxMBSortInHeap=7.593462795584012, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=en-SL, timezone=Asia/Harbin
[junit4] 2> NOTE: Linux 5.3.0-59-generic amd64/AdoptOpenJDK 11.0.6 (64-bit)/cpus=16,threads=1,free=366194624,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [RankQParserPluginTest, TestMinMaxOnMultiValuedField, TestCharFilters, SolrJmxReporterCloudTest, JWTVerificationkeyResolverTest, TestMacros, XMLAtomicUpdateMultivalueTest, XsltUpdateRequestHandlerTest, DirectoryFactoryTest, TestSimExtremeIndexing, BadIndexSchemaTest, TestBulkSchemaAPI, PeerSyncWithBufferUpdatesTest, TestMultiValuedNumericRangeQuery, TestExactSharedStatsCache, TestCloudRecovery, MetricTriggerIntegrationTest, ResolveAnalyzerByNameTest, SearchRateTriggerTest, TestCrossCoreJoin, TestDFRSimilarityFactory, TestFilteredDocIdSet, NodeMarkersRegistrationTest, ClassificationUpdateProcessorIntegrationTest, TestPackages, TestUseDocValuesAsStored2, TestSimScenario]
[junit4] Completed [143/916 (1!)] on J0 in 5.17s, 4 tests, 1 failure <<< FAILURES!
[...truncated 54746 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/27257/consoleText
[repro] Revision: fc5887181b75d7e622ca31ebf0531f8d3b7599d8
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=TestSimScenario -Dtests.method=testSplitShard -Dtests.seed=650F2C6F0937DE68 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-SL -Dtests.timezone=Asia/Harbin -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestSimScenario
[repro] ant compile-test
[...truncated 2449 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestSimScenario" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=650F2C6F0937DE68 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-SL -Dtests.timezone=Asia/Harbin -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 96 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
[repro] Exiting with code 0
[...truncated 49 lines...]
[JENKINS-Experimental-GC] Lucene-Solr-master-Linux
(64bit/jdk-12.0.2) - Build # 27258 - Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/27258/
Java: 64bit/jdk-12.0.2 -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC
All tests passed
Build Log:
[...truncated 13790 lines...]
[junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20200708_184303_2281300530432202501267.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # A fatal error has been detected by the Java Runtime Environment:
[junit4] #
[junit4] # SIGILL (0x4) at pc=0x00007fe4bee29b9e, pid=16107, tid=23297
[junit4] #
[junit4] # JRE version: OpenJDK Runtime Environment (12.0.2+10) (build 12.0.2+10)
[junit4] # Java VM: OpenJDK 64-Bit Server VM (12.0.2+10, mixed mode, tiered, z gc, linux-amd64)
[junit4] # Problematic frame:
[junit4] # J 46833 c2 org.apache.solr.schema.TrieField.readableToIndexed(Ljava/lang/CharSequence;Lorg/apache/lucene/util/BytesRefBuilder;)V (147 bytes) @ 0x00007fe4bee29b9e [0x00007fe4bee289e0+0x00000000000011be]
[junit4] #
[junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
[junit4] #
[junit4] # An error report file with more information is saved as:
[junit4] # /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/hs_err_pid16107.log
[junit4] Compiled method (c2) 766084 46833 4 org.apache.solr.schema.TrieField::readableToIndexed (147 bytes)
[junit4] total in heap [0x00007fe4bee28710,0x00007fe4bee2ae48] = 10040
[junit4] relocation [0x00007fe4bee28888,0x00007fe4bee289c8] = 320
[junit4] main code [0x00007fe4bee289e0,0x00007fe4bee2a080] = 5792
[junit4] stub code [0x00007fe4bee2a080,0x00007fe4bee2a110] = 144
[junit4] oops [0x00007fe4bee2a110,0x00007fe4bee2a128] = 24
[junit4] metadata [0x00007fe4bee2a128,0x00007fe4bee2a1e0] = 184
[junit4] scopes data [0x00007fe4bee2a1e0,0x00007fe4bee2a7d0] = 1520
[junit4] scopes pcs [0x00007fe4bee2a7d0,0x00007fe4bee2ac30] = 1120
[junit4] dependencies [0x00007fe4bee2ac30,0x00007fe4bee2ac40] = 16
[junit4] handler table [0x00007fe4bee2ac40,0x00007fe4bee2ad78] = 312
[junit4] nul chk table [0x00007fe4bee2ad78,0x00007fe4bee2ae48] = 208
[junit4] Compiled method (c1) 766084 46703 3 org.apache.solr.schema.TrieField::toInternal (6 bytes)
[junit4] total in heap [0x00007fe4b9343310,0x00007fe4b9343f28] = 3096
[junit4] relocation [0x00007fe4b9343488,0x00007fe4b9343538] = 176
[junit4] main code [0x00007fe4b9343540,0x00007fe4b9343be0] = 1696
[junit4] stub code [0x00007fe4b9343be0,0x00007fe4b9343cb8] = 216
[junit4] oops [0x00007fe4b9343cb8,0x00007fe4b9343cc8] = 16
[junit4] metadata
[junit4] [0x00007fe4b9343cc8,0x00007fe4b9343d10] = 72
[junit4] scopes data [0x00007fe4b9343d10,0x00007fe4b9343df0] = 224
[junit4] scopes pcs [0x00007fe4b9343df0,0x00007fe4b9343f10] = 288
[junit4] dependencies [0x00007fe4b9343f10,0x00007fe4b9343f18] = 8
[junit4] nul chk table [0x00007fe4b9343f18,0x00007fe4b9343f28] = 16
[junit4] Could not load hsdis-amd64.so; library not loadable; PrintAssembly is disabled
[junit4] #
[junit4] # If you would like to submit a bug report, please visit:
[junit4] # https://github.com/AdoptOpenJDK/openjdk-build/issues
[junit4] #
[junit4] <<< JVM J0: EOF ----
[...truncated 1460 lines...]
[junit4] ERROR: JVM J0 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-12.0.2/bin/java -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps -ea -esa --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=F61AAF1EB052ACE8 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=9.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/etc/security.policy -Dtests.LUCENE_VERSION=9.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-master-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp -Djunit4.childvm.id=0 -Djunit4.childvm.count=6 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=false -classpath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/junit4-ant-2.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/opentracing-mock-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/lucene-analyzers-common-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/nori/lucene-analyzers-nori-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/lucene-codecs-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/lucene-backward-codecs-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/lucene-highlighter-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/lucene-memory-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/lucene-misc-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/lucene-spatial-extras-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/lucene-spatial3d-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/lucene-expressions-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/lucene-suggest-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/lucene-grouping-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/lucene-queries-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/lucene-queryparser-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/lucene-join-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/lucene-sandbox-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/lucene-classification-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-commons-7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/avatica-core-1.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/caffeine-2.8.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/calcite-core-1.18.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/calcite-linq4j-1.18.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-cli-1.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-codec-1.13.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-collections-3.2.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-compiler-3.0.9.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-configuration2-2.1.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-exec-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-io-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-lang3-3.9.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-text-1.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-client-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-framework-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-recipes-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/disruptor-3.4.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/eigenbase-properties-1.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/guava-25.1-jre.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-annotations-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-auth-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-common-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-hdfs-client-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hppc-0.8.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/htrace-core4-4.1.0-incubating.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-annotations-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-core-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-databind-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-dataformat-smile-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/janino-3.0.9.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/java-semver-0.9.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jose4j-0.6.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/json-path-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerb-core-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerb-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerby-asn1-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerby-pkix-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-1.2-api-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-api-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-core-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-slf4j-impl-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/opentracing-api-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/opentracing-noop-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/opentracing-util-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet-2.4.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet.ext.servlet-2.4.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/protobuf-java-3.11.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/re2j-1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/rrd4j-3.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/s2-geometry-library-java-1.0.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/spatial4j-0.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/t-digest-3.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-io-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-lang-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-common-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-hpack-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-http-client-transport-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpclient-4.5.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpcore-4.4.12.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpmime-4.5.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-alpn-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-alpn-java-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-http-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-io-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-util-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-buffer-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-codec-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-common-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-handler-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-resolver-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-transport-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-transport-native-epoll-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-transport-native-unix-common-4.1.50.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/slf4j-api-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/snappy-java-1.1.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/stax2-api-3.1.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/zookeeper-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/zookeeper-jute-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-common-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-hpack-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/javax.servlet-api-3.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-alpn-java-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-alpn-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-continuation-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-deploy-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-http-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-io-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-jmx-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-rewrite-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-security-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlet-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlets-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-util-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-webapp-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-xml-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-core-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-graphite-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jetty9-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jmx-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jvm-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/byte-buddy-1.9.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-compress-1.19.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-logging-1.1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-text-1.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-common-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-minikdc-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/jersey-servlet-1.19.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-admin-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-client-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-common-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-crypto-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-identity-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-server-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-simplekdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-config-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-kdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/mockito-core-2.23.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/objenesis-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/opentracing-mock-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/lucene-analyzers-icu-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analysis-extras/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/contrib/analysis-extras/lib/icu4j-62.2.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.6.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20200708_184303_2288839985997150036679.events @/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20200708_184303_22811189248711338479505.suites -stdin
[junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20200708_184303_2281300530432202501267.sysout
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
[junit4] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] at java.base/java.lang.Thread.run(Thread.java:835)
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:635: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:579: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:232: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/common-build.xml:549: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1521: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1048: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20200708_184303_2281300530432202501267.sysout
Total time: 37 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Archiving artifacts
[Java] Skipping execution of recorder since overall result is 'FAILURE'
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2