You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/05/20 06:51:57 UTC

[JENKINS-Experimental-GC] Lucene-Solr-8.x-Linux (64bit/jdk-11.0.6) - Build # 3124 - Failure!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/3124/
Java: 64bit/jdk-11.0.6 -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC

All tests passed

Build Log:
[...truncated 14758 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20200520_062559_7481072212088323898757.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # A fatal error has been detected by the Java Runtime Environment:
   [junit4] #
   [junit4] #  SIGILL (0x4) at pc=0x00007f5811e51c66, pid=17927, tid=26091
   [junit4] #
   [junit4] # JRE version: OpenJDK Runtime Environment (11.0.6+10) (build 11.0.6+10)
   [junit4] # Java VM: OpenJDK 64-Bit Server VM (11.0.6+10, mixed mode, tiered, z gc, linux-amd64)
   [junit4] # Problematic frame:
   [junit4] # J 41829 c2 org.apache.solr.schema.TrieField.storedToIndexed(Lorg/apache/lucene/index/IndexableField;Lorg/apache/lucene/util/BytesRefBuilder;)V (181 bytes) @ 0x00007f5811e51c66 [0x00007f5811e51500+0x0000000000000766]
   [junit4] #
   [junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
   [junit4] #
   [junit4] # An error report file with more information is saved as:
   [junit4] # /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J0/hs_err_pid17927.log
   [junit4] Compiled method (c2)  566378 41829       4       org.apache.solr.schema.TrieField::storedToIndexed (181 bytes)
   [junit4]  total in heap  [0x00007f5811e51310,0x00007f5811e523c8] = 4280
   [junit4]  relocation     [0x00007f5811e51488,0x00007f5811e514f8] = 112
   [junit4]  main code      [0x00007f5811e51500,0x00007f5811e51e40] = 2368
   [junit4]  stub code      [0x00007f5811e51e40,0x00007f5811e51e58] = 24
   [junit4]  oops           [0x00007f5811e51e58,0x00007f5811e51e68] = 16
   [junit4]  metadata       [0x00007f5811e51e68,0x00007f5811e51eb0] = 72
   [junit4]  scopes data    [0x00007f5811e51eb0,0x00007f5811e52150] = 672
   [junit4]  scopes pcs     [0x00007f5811e52150,0x00007f5811e52320] = 464
   [junit4]  dependencies   [0x00007f5811e52320,0x00007f5811e52328] = 8
   [junit4]  handler table  [0x00007f5811e52328,0x00007f5811e52358] = 48
   [junit4]  nul chk table  [0x00007f5811e52358,0x00007f5811e523c8] = 112
   [junit4] Compiled method (c2)  566381 41829       4       org.apache.solr.schema.TrieField::storedToIndexed (181 bytes)
   [junit4]  total in heap  [0x00007f5811e51310,0x00007f5811e523c8] = 4280
   [junit4]  relocation     [0x00007f5811e51488,0x00007f5811e514f8] = 112
   [junit4]  main code      [0x00007f5811e51500,0x00007f5811e51e40] = 2368
   [junit4]  stub code      [0x00007f5811e51e40,0x00007f5811e51e58] = 24
   [junit4]  oops           [0x00007f5811e51e58,0x00007f5811e51e68] = 16
   [junit4]  met
   [junit4] adata       [0x00007f5811e51e68,0x00007f5811e51eb0] = 72
   [junit4]  scopes data    [0x00007f5811e51eb0,0x00007f5811e52150] = 672
   [junit4]  scopes pcs     [0x00007f5811e52150,0x00007f5811e52320] = 464
   [junit4]  dependencies   [0x00007f5811e52320,0x00007f5811e52328] = 8
   [junit4]  handler table  [0x00007f5811e52328,0x00007f5811e52358] = 48
   [junit4]  nul chk table  [0x00007f5811e52358,0x00007f5811e523c8] = 112
   [junit4] Compiled method (c1)  566382 41147       3       org.apache.solr.schema.TrieField::createFields (229 bytes)
   [junit4]  total in heap  [0x00007f580960a790,0x00007f580960ebe8] = 17496
   [junit4]  relocation     [0x00007f580960a908,0x00007f580960acc8] = 960
   [junit4]  main code      [0x00007f580960ace0,0x00007f580960dae0] = 11776
   [junit4]  stub code      [0x00007f580960dae0,0x00007f580960dd08] = 552
   [junit4]  oops           [0x00007f580960dd08,0x00007f580960dd18] = 16
   [junit4]  metadata       [0x00007f580960dd18,0x00007f580960ddf0] = 216
   [junit4]  scopes data    [0x00007f580960ddf0,0x00007f580960e4c0] = 1744
   [junit4]  scopes pcs     [0x00007f580960e4c0,0x00007f580960eb30] = 1648
   [junit4]  dependencies   [0x00007f580960eb30,0x00007f580960eb38] = 8
   [junit4]  nul chk table  [0x00007f580960eb38,0x00007f580960ebe8] = 176
   [junit4] Could not load hsdis-amd64.so; library not loadable; PrintAssembly is disabled
   [junit4] #
   [junit4] # If you would like to submit a bug report, please visit:
   [junit4] #   https://github.com/AdoptOpenJDK/openjdk-support/issues
   [junit4] #
   [junit4] <<< JVM J0: EOF ----

[...truncated 1742 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-11.0.6/bin/java -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/heapdumps -ea -esa -da:java.util.HashMap --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=A94B0A9D4ACD8177 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=8.6.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/etc/security.policy -Dtests.LUCENE_VERSION=8.6.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-8.x-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J0 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/temp -Djunit4.childvm.id=0 -Djunit4.childvm.count=6 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=false -classpath /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/classes/test:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/test-framework/lib/junit4-ant-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/test-framework/lib/opentracing-mock-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/src/test-files:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-solrj/classes/java:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/classes/java:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/analysis/nori/lucene-analyzers-nori-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/codecs/lucene-codecs-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/backward-codecs/lucene-backward-codecs-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/highlighter/lucene-highlighter-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/memory/lucene-memory-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/misc/lucene-misc-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/spatial-extras/lucene-spatial-extras-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/spatial3d/lucene-spatial3d-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/expressions/lucene-expressions-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/suggest/lucene-suggest-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/grouping/lucene-grouping-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/queries/lucene-queries-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/queryparser/lucene-queryparser-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/join/lucene-join-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/sandbox/lucene-sandbox-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/classification/lucene-classification-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/asm-7.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/asm-commons-7.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/avatica-core-1.13.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/caffeine-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/calcite-core-1.18.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/calcite-linq4j-1.18.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-cli-1.4.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-codec-1.13.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-collections-3.2.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-compiler-3.0.9.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-configuration2-2.1.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-exec-1.3.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-fileupload-1.3.3.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-io-2.6.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-lang3-3.9.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/commons-text-1.6.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/curator-client-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/curator-framework-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/curator-recipes-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/disruptor-3.4.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/eigenbase-properties-1.1.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/guava-25.1-jre.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/hadoop-annotations-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/hadoop-auth-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/hadoop-common-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/hadoop-hdfs-client-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/hppc-0.8.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/htrace-core4-4.1.0-incubating.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/jackson-annotations-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/jackson-core-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/jackson-databind-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/jackson-dataformat-smile-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/janino-3.0.9.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/java-semver-0.9.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/jose4j-0.6.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/json-path-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/kerb-core-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/kerb-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/kerby-asn1-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/kerby-pkix-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/log4j-1.2-api-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/log4j-api-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/log4j-core-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/log4j-slf4j-impl-2.13.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/opentracing-api-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/opentracing-noop-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/opentracing-util-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/org.restlet-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/protobuf-java-3.11.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/re2j-1.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/rrd4j-3.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/s2-geometry-library-java-1.0.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/spatial4j-0.7.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/lib/t-digest-3.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/commons-io-2.6.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/http2-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/http2-common-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/http2-hpack-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/http2-http-client-transport-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/httpclient-4.5.10.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/httpcore-4.4.12.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/httpmime-4.5.10.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/jetty-alpn-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/jetty-alpn-java-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/jetty-client-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/jetty-http-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/jetty-io-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/jetty-util-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-buffer-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-codec-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-common-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-handler-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-resolver-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-transport-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-transport-native-epoll-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/netty-transport-native-unix-common-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/slf4j-api-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/stax2-api-3.1.4.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/zookeeper-3.5.7.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/solrj/lib/zookeeper-jute-3.5.7.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/http2-common-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/http2-hpack-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/http2-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/javax.servlet-api-3.1.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-alpn-java-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-alpn-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-continuation-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-deploy-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-http-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-io-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-jmx-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-rewrite-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-security-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-server-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-servlet-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-servlets-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-util-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-webapp-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/jetty-xml-9.4.27.v20200227.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/metrics-core-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/metrics-graphite-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/metrics-jetty9-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/metrics-jmx-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/lib/metrics-jvm-4.1.5.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/byte-buddy-1.9.3.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/commons-compress-1.19.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/commons-logging-1.1.3.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/commons-text-1.6.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/hadoop-common-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/hadoop-minicluster-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/hadoop-minikdc-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/jersey-core-1.19.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/jersey-server-1.19.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/jersey-servlet-1.19.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerb-admin-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerb-client-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerb-common-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerb-crypto-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerb-identity-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerb-server-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerb-simplekdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerby-config-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerby-kdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/kerby-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/mockito-core-2.23.4.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/netty-all-4.1.47.Final.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/objenesis-2.6.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/core/test-lib/opentracing-mock-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/analysis/icu/lucene-analyzers-icu-8.6.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/contrib/solr-analysis-extras/classes/java:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/queryparser/classes/test:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/build/backward-codecs/classes/test:/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/contrib/analysis-extras/lib/icu4j-62.1.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.2.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20200520_062559_74815795798828821726594.events @/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20200520_062559_74814443961807456486845.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20200520_062559_7481072212088323898757.sysout
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
   [junit4] 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   [junit4] 	at java.base/java.lang.Thread.run(Thread.java:834)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/build.xml:634: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/build.xml:578: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build.xml:231: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/common-build.xml:550: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/common-build.xml:1599: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/lucene/common-build.xml:1126: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20200520_062559_7481072212088323898757.sysout

Total time: 38 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-8.x-Linux (64bit/jdk-13.0.2) - Build # 3125 - Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/3125/
Java: 64bit/jdk-13.0.2 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard

Error Message:
java.util.concurrent.TimeoutException: OverseerTriggerThread never caught up to the latest znodeVersion

Stack Trace:
java.lang.AssertionError: java.util.concurrent.TimeoutException: OverseerTriggerThread never caught up to the latest znodeVersion
	at __randomizedtesting.SeedInfo.seed([EBFB7E1463924708:30F1D3787D677BB7]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard(TestSimScenario.java:159)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)




Build Log:
[...truncated 14201 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
   [junit4]   2> 377585 INFO  (SUITE-TestSimScenario-seed#[EBFB7E1463924708]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 377585 INFO  (SUITE-TestSimScenario-seed#[EBFB7E1463924708]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 377586 INFO  (SUITE-TestSimScenario-seed#[EBFB7E1463924708]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.sim.TestSimScenario_EBFB7E1463924708-001/data-dir-54-001
   [junit4]   2> 377587 INFO  (SUITE-TestSimScenario-seed#[EBFB7E1463924708]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 377587 INFO  (SUITE-TestSimScenario-seed#[EBFB7E1463924708]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 377589 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testSuggestions
   [junit4]   2> 377596 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 1.	CreateCluster	numNodes=2
   [junit4]   2> 377596 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		CreateCluster	numNodes=2
   [junit4]   2> 377598 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10001_solr
   [junit4]   2> 377599 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=0
   [junit4]   2> 377599 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 377599 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 377599 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 2.	LoadAutoscaling	json={'cluster-policy':[]}
   [junit4]   2> 377599 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 377599 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		LoadAutoscaling	json={'cluster-policy':[]}
   [junit4]   2> 377599 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 377599 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 377599 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 377599 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 377600 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
   [junit4]   2> 377600 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 377600 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 377600 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 377600 DEBUG (ScheduledTrigger-4851-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377600 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 377600 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 3.	RunSolrRequest	path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 377600 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 377600 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		RunSolrRequest	path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 377600 DEBUG (simCloudManagerPool-4850-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection, currentVersion=1
   [junit4]   2> 377600 DEBUG (simCloudManagerPool-4850-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=1
   [junit4]   2> 377601 DEBUG (simCloudManagerPool-4850-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 377611 DEBUG (simCloudManagerPool-4850-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=2
   [junit4]   2> 377611 DEBUG (simCloudManagerPool-4850-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 377620 DEBUG (ScheduledTrigger-4851-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377622 DEBUG (simCloudManagerPool-4850-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=3
   [junit4]   2> 377622 DEBUG (simCloudManagerPool-4850-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 377622 DEBUG (simCloudManagerPool-4850-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard1)
   [junit4]   2> 377622 DEBUG (simCloudManagerPool-4850-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard1 (currentVersion=4): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 377634 DEBUG (simCloudManagerPool-4850-thread-3) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=4
   [junit4]   2> 377634 DEBUG (simCloudManagerPool-4850-thread-3) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 377641 DEBUG (ScheduledTrigger-4851-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377645 DEBUG (simCloudManagerPool-4850-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=5
   [junit4]   2> 377645 DEBUG (simCloudManagerPool-4850-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 377645 DEBUG (simCloudManagerPool-4850-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard2)
   [junit4]   2> 377645 DEBUG (simCloudManagerPool-4850-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard2 (currentVersion=6): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 377645 DEBUG (simCloudManagerPool-4850-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection, currentVersion=6
   [junit4]   2> 377645 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 4.	WaitCollection	collection=testCollection&shards=2&replicas=2
   [junit4]   2> 377645 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		WaitCollection	collection=testCollection&shards=2&replicas=2
   [junit4]   2> 377655 DEBUG (simCloudManagerPool-4850-thread-5) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=6
   [junit4]   2> 377656 DEBUG (simCloudManagerPool-4850-thread-5) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 377656 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=7
   [junit4]   2> 377656 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 377656 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 5.	CtxSet	key=myNode&value=${_random_node_}
   [junit4]   2> 377656 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		CtxSet	key=myNode&value=127.0.0.1:10001_solr
   [junit4]   2> 377656 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 6.	RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 377656 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10001_solr
   [junit4]   2> 377657 INFO  (simCloudManagerPool-4850-thread-6) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10001_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 377657 INFO  (simCloudManagerPool-4850-thread-6) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 377661 DEBUG (ScheduledTrigger-4851-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377668 DEBUG (simCloudManagerPool-4850-thread-6) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=8
   [junit4]   2> 377668 DEBUG (simCloudManagerPool-4850-thread-6) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 377668 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 7.	RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 377668 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10001_solr
   [junit4]   2> 377668 DEBUG (simCloudManagerPool-4850-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=9
   [junit4]   2> 377669 DEBUG (simCloudManagerPool-4850-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 377669 INFO  (simCloudManagerPool-4850-thread-7) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10001_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 377669 INFO  (simCloudManagerPool-4850-thread-7) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 377679 DEBUG (simCloudManagerPool-4850-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=10
   [junit4]   2> 377680 DEBUG (simCloudManagerPool-4850-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 377680 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 8.	LoopOp	iterations=${iterative}
   [junit4]   2> 377680 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		LoopOp	iterations=0
   [junit4]   2> 377680 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 9.	LoopOp	iterations=${justCalc}
   [junit4]   2> 377680 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		LoopOp	iterations=1
   [junit4]   2> 377680 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 1 :
   [junit4]   2> 377680 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 377680 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=11
   [junit4]   2> 377680 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 377681 DEBUG (ScheduledTrigger-4851-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377686 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 377686 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - SaveSnapshot	path=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.sim.TestSimScenario_EBFB7E1463924708-001/tempDir-001/snapshot/0)
   [junit4]   2> 377688 WARN  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimUtils V2 action SET_CLUSTER_PROPERTY_OBJ has no equivalent V1 action
   [junit4]   2> 377688 WARN  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimUtils V2 action GET_NODES has no equivalent V1 action
   [junit4]   2> 377691 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from SimDistribStateManager
   [junit4]   2> 377700 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 10.	Dump	redact=true
   [junit4]   2> 377700 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		Dump	redact=true
   [junit4]   2> 377700 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from SimDistribStateManager
   [junit4]   2> 377701 DEBUG (ScheduledTrigger-4851-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377702 INFO  (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 377702 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 377703 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 377703 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 377703 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 377703 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 377703 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 377703 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 1.	CreateCluster	numNodes=2
   [junit4]   2> 377703 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		CreateCluster	numNodes=2
   [junit4]   2> 377705 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10003_solr
   [junit4]   2> 377705 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=0
   [junit4]   2> 377705 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 377705 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 377705 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 377705 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 2.	LoadAutoscaling	json={'cluster-policy':[]}
   [junit4]   2> 377705 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		LoadAutoscaling	json={'cluster-policy':[]}
   [junit4]   2> 377705 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 377705 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 377705 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 377705 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 377706 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10004_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 377706 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 377706 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 377706 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 377706 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377706 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 377706 DEBUG (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 377711 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 3.	RunSolrRequest	path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 377711 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		RunSolrRequest	path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 377711 DEBUG (simCloudManagerPool-4856-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection, currentVersion=1
   [junit4]   2> 377711 DEBUG (simCloudManagerPool-4856-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=1
   [junit4]   2> 377711 DEBUG (simCloudManagerPool-4856-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 377721 DEBUG (simCloudManagerPool-4856-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=2
   [junit4]   2> 377721 DEBUG (simCloudManagerPool-4856-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 377726 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377732 DEBUG (simCloudManagerPool-4856-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=3
   [junit4]   2> 377733 DEBUG (simCloudManagerPool-4856-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 377733 DEBUG (simCloudManagerPool-4856-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard1)
   [junit4]   2> 377733 DEBUG (simCloudManagerPool-4856-thread-2) [     ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard1 (currentVersion=4): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 377743 DEBUG (simCloudManagerPool-4856-thread-3) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=4
   [junit4]   2> 377743 DEBUG (simCloudManagerPool-4856-thread-3) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 377746 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377753 DEBUG (simCloudManagerPool-4856-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=5
   [junit4]   2> 377754 DEBUG (simCloudManagerPool-4856-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 377754 DEBUG (simCloudManagerPool-4856-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / shard2)
   [junit4]   2> 377754 DEBUG (simCloudManagerPool-4856-thread-4) [     ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / shard2 (currentVersion=6): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 377754 DEBUG (simCloudManagerPool-4856-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection, currentVersion=6
   [junit4]   2> 377754 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 4.	WaitCollection	collection=testCollection&shards=2&replicas=2
   [junit4]   2> 377754 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		WaitCollection	collection=testCollection&shards=2&replicas=2
   [junit4]   2> 377764 DEBUG (simCloudManagerPool-4856-thread-5) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=6
   [junit4]   2> 377764 DEBUG (simCloudManagerPool-4856-thread-5) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 377764 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=7
   [junit4]   2> 377765 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 377765 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 5.	CtxSet	key=myNode&value=${_random_node_}
   [junit4]   2> 377765 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		CtxSet	key=myNode&value=127.0.0.1:10003_solr
   [junit4]   2> 377765 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 6.	RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 377765 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr
   [junit4]   2> 377765 INFO  (simCloudManagerPool-4856-thread-6) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 377765 INFO  (simCloudManagerPool-4856-thread-6) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 377766 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377775 DEBUG (simCloudManagerPool-4856-thread-6) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=8
   [junit4]   2> 377776 DEBUG (simCloudManagerPool-4856-thread-6) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 377776 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 7.	RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 377776 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr
   [junit4]   2> 377776 DEBUG (simCloudManagerPool-4856-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=9
   [junit4]   2> 377776 DEBUG (simCloudManagerPool-4856-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 377777 INFO  (simCloudManagerPool-4856-thread-7) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 377777 INFO  (simCloudManagerPool-4856-thread-7) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 377786 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377787 DEBUG (simCloudManagerPool-4856-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=10
   [junit4]   2> 377787 DEBUG (simCloudManagerPool-4856-thread-7) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 377787 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 8.	LoopOp	iterations=${iterative}
   [junit4]   2> 377787 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		LoopOp	iterations=10
   [junit4]   2> 377787 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 1 :
   [junit4]   2> 377787 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 377787 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=11
   [junit4]   2> 377788 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 377788 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 377788 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 377807 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377827 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377847 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377867 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377887 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377890 DEBUG (simCloudManagerPool-4856-thread-8) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node10":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n9",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 377907 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377927 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377948 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377968 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 377988 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378001 DEBUG (simCloudManagerPool-4856-thread-8) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=12
   [junit4]   2> 378001 DEBUG (simCloudManagerPool-4856-thread-8) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 378001 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378001 DEBUG (simCloudManagerPool-4856-thread-9) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=13
   [junit4]   2> 378002 DEBUG (simCloudManagerPool-4856-thread-9) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 378002 INFO  (simCloudManagerPool-4856-thread-9) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378002 INFO  (simCloudManagerPool-4856-thread-9) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378008 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378012 DEBUG (simCloudManagerPool-4856-thread-9) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=14
   [junit4]   2> 378012 DEBUG (simCloudManagerPool-4856-thread-9) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 378012 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378013 DEBUG (simCloudManagerPool-4856-thread-10) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=15
   [junit4]   2> 378013 DEBUG (simCloudManagerPool-4856-thread-10) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 15
   [junit4]   2> 378013 INFO  (simCloudManagerPool-4856-thread-10) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378013 INFO  (simCloudManagerPool-4856-thread-10) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378024 DEBUG (simCloudManagerPool-4856-thread-10) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=16
   [junit4]   2> 378024 DEBUG (simCloudManagerPool-4856-thread-10) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 16
   [junit4]   2> 378024 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 2 :
   [junit4]   2> 378024 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 378024 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=17
   [junit4]   2> 378024 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 17
   [junit4]   2> 378025 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 378025 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 378028 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378048 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378068 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378089 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378109 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378125 DEBUG (simCloudManagerPool-4856-thread-11) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node16":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n15",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 378129 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378149 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378169 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378189 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378209 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378229 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378236 DEBUG (simCloudManagerPool-4856-thread-11) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=18
   [junit4]   2> 378236 DEBUG (simCloudManagerPool-4856-thread-11) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 18
   [junit4]   2> 378236 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378236 DEBUG (simCloudManagerPool-4856-thread-12) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=19
   [junit4]   2> 378237 DEBUG (simCloudManagerPool-4856-thread-12) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 19
   [junit4]   2> 378237 INFO  (simCloudManagerPool-4856-thread-12) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378237 INFO  (simCloudManagerPool-4856-thread-12) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378247 DEBUG (simCloudManagerPool-4856-thread-12) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=20
   [junit4]   2> 378248 DEBUG (simCloudManagerPool-4856-thread-12) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 20
   [junit4]   2> 378248 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378248 DEBUG (simCloudManagerPool-4856-thread-13) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=21
   [junit4]   2> 378248 DEBUG (simCloudManagerPool-4856-thread-13) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 21
   [junit4]   2> 378248 INFO  (simCloudManagerPool-4856-thread-13) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378249 INFO  (simCloudManagerPool-4856-thread-13) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378249 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378259 DEBUG (simCloudManagerPool-4856-thread-13) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=22
   [junit4]   2> 378259 DEBUG (simCloudManagerPool-4856-thread-13) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 22
   [junit4]   2> 378259 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 3 :
   [junit4]   2> 378259 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 378259 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=23
   [junit4]   2> 378259 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 23
   [junit4]   2> 378260 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 378260 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 378270 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378290 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378310 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378330 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378350 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378361 DEBUG (simCloudManagerPool-4856-thread-14) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node22":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n21",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 378370 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378390 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378411 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378431 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378451 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378471 DEBUG (simCloudManagerPool-4856-thread-14) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=24
   [junit4]   2> 378471 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378471 DEBUG (simCloudManagerPool-4856-thread-14) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 24
   [junit4]   2> 378471 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378472 DEBUG (simCloudManagerPool-4856-thread-15) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=25
   [junit4]   2> 378472 DEBUG (simCloudManagerPool-4856-thread-15) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 25
   [junit4]   2> 378472 INFO  (simCloudManagerPool-4856-thread-15) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378472 INFO  (simCloudManagerPool-4856-thread-15) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378483 DEBUG (simCloudManagerPool-4856-thread-15) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=26
   [junit4]   2> 378483 DEBUG (simCloudManagerPool-4856-thread-15) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 26
   [junit4]   2> 378483 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378483 DEBUG (simCloudManagerPool-4856-thread-16) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=27
   [junit4]   2> 378483 DEBUG (simCloudManagerPool-4856-thread-16) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 27
   [junit4]   2> 378484 INFO  (simCloudManagerPool-4856-thread-16) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378484 INFO  (simCloudManagerPool-4856-thread-16) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378491 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378494 DEBUG (simCloudManagerPool-4856-thread-16) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=28
   [junit4]   2> 378494 DEBUG (simCloudManagerPool-4856-thread-16) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 28
   [junit4]   2> 378494 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 4 :
   [junit4]   2> 378494 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 378494 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=29
   [junit4]   2> 378495 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 29
   [junit4]   2> 378495 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 378495 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 378511 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378531 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378551 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378572 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378594 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378596 DEBUG (simCloudManagerPool-4856-thread-17) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node28":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n27",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 378614 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378634 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378654 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378675 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378695 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378706 DEBUG (simCloudManagerPool-4856-thread-17) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=30
   [junit4]   2> 378706 DEBUG (simCloudManagerPool-4856-thread-17) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 30
   [junit4]   2> 378706 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378707 DEBUG (simCloudManagerPool-4856-thread-18) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=31
   [junit4]   2> 378707 DEBUG (simCloudManagerPool-4856-thread-18) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 31
   [junit4]   2> 378707 INFO  (simCloudManagerPool-4856-thread-18) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378707 INFO  (simCloudManagerPool-4856-thread-18) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378715 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378717 DEBUG (simCloudManagerPool-4856-thread-18) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=32
   [junit4]   2> 378718 DEBUG (simCloudManagerPool-4856-thread-18) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 32
   [junit4]   2> 378718 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378718 DEBUG (simCloudManagerPool-4856-thread-19) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=33
   [junit4]   2> 378718 DEBUG (simCloudManagerPool-4856-thread-19) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 33
   [junit4]   2> 378719 INFO  (simCloudManagerPool-4856-thread-19) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378719 INFO  (simCloudManagerPool-4856-thread-19) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378729 DEBUG (simCloudManagerPool-4856-thread-19) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=34
   [junit4]   2> 378729 DEBUG (simCloudManagerPool-4856-thread-19) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 34
   [junit4]   2> 378729 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 5 :
   [junit4]   2> 378729 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 378729 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=35
   [junit4]   2> 378729 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 35
   [junit4]   2> 378730 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 378730 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 378735 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378755 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378775 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378795 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378815 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378830 DEBUG (simCloudManagerPool-4856-thread-20) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node34":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n33",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 378836 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378856 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378876 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378896 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378916 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378936 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378941 DEBUG (simCloudManagerPool-4856-thread-20) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=36
   [junit4]   2> 378941 DEBUG (simCloudManagerPool-4856-thread-20) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 36
   [junit4]   2> 378941 DEBUG (MetricsHistoryHandler-4860-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=37
   [junit4]   2> 378941 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378942 DEBUG (MetricsHistoryHandler-4860-thread-1) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 37
   [junit4]   2> 378942 INFO  (simCloudManagerPool-4856-thread-21) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378942 INFO  (simCloudManagerPool-4856-thread-21) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378952 DEBUG (simCloudManagerPool-4856-thread-21) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=38
   [junit4]   2> 378953 DEBUG (simCloudManagerPool-4856-thread-21) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 38
   [junit4]   2> 378953 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 378953 DEBUG (simCloudManagerPool-4856-thread-22) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=39
   [junit4]   2> 378953 DEBUG (simCloudManagerPool-4856-thread-22) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 39
   [junit4]   2> 378953 INFO  (simCloudManagerPool-4856-thread-22) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 378953 INFO  (simCloudManagerPool-4856-thread-22) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 378956 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378964 DEBUG (simCloudManagerPool-4856-thread-22) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=40
   [junit4]   2> 378964 DEBUG (simCloudManagerPool-4856-thread-22) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 40
   [junit4]   2> 378964 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 6 :
   [junit4]   2> 378964 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 378964 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=41
   [junit4]   2> 378964 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 41
   [junit4]   2> 378965 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 378965 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 378976 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 378997 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379017 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379037 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379057 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379065 DEBUG (simCloudManagerPool-4856-thread-23) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node40":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n39",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 379077 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379097 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379117 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379137 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379158 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379176 DEBUG (simCloudManagerPool-4856-thread-23) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=42
   [junit4]   2> 379176 DEBUG (simCloudManagerPool-4856-thread-23) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 42
   [junit4]   2> 379176 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 379177 DEBUG (simCloudManagerPool-4856-thread-24) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=43
   [junit4]   2> 379177 DEBUG (simCloudManagerPool-4856-thread-24) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 43
   [junit4]   2> 379177 INFO  (simCloudManagerPool-4856-thread-24) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 379177 INFO  (simCloudManagerPool-4856-thread-24) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 379178 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379187 DEBUG (simCloudManagerPool-4856-thread-24) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=44
   [junit4]   2> 379188 DEBUG (simCloudManagerPool-4856-thread-24) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 44
   [junit4]   2> 379188 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 379188 DEBUG (simCloudManagerPool-4856-thread-25) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=45
   [junit4]   2> 379188 DEBUG (simCloudManagerPool-4856-thread-25) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 45
   [junit4]   2> 379189 INFO  (simCloudManagerPool-4856-thread-25) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 379189 INFO  (simCloudManagerPool-4856-thread-25) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 379198 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379199 DEBUG (simCloudManagerPool-4856-thread-25) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=46
   [junit4]   2> 379199 DEBUG (simCloudManagerPool-4856-thread-25) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 46
   [junit4]   2> 379199 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 7 :
   [junit4]   2> 379199 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 379199 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=47
   [junit4]   2> 379200 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 47
   [junit4]   2> 379200 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 379200 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 379218 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379238 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379258 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379278 DEBUG (ScheduledTrigger-4857-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379298 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379301 DEBUG (simCloudManagerPool-4856-thread-26) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node46":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n45",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 379319 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379339 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379359 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379379 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379399 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379411 DEBUG (simCloudManagerPool-4856-thread-26) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=48
   [junit4]   2> 379412 DEBUG (simCloudManagerPool-4856-thread-26) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 48
   [junit4]   2> 379412 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 379413 DEBUG (simCloudManagerPool-4856-thread-27) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=49
   [junit4]   2> 379414 DEBUG (simCloudManagerPool-4856-thread-27) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 49
   [junit4]   2> 379414 INFO  (simCloudManagerPool-4856-thread-27) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 379415 INFO  (simCloudManagerPool-4856-thread-27) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 379419 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379425 DEBUG (simCloudManagerPool-4856-thread-27) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=50
   [junit4]   2> 379425 DEBUG (simCloudManagerPool-4856-thread-27) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 50
   [junit4]   2> 379425 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 379426 DEBUG (simCloudManagerPool-4856-thread-28) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=51
   [junit4]   2> 379426 DEBUG (simCloudManagerPool-4856-thread-28) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 51
   [junit4]   2> 379426 INFO  (simCloudManagerPool-4856-thread-28) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 379427 INFO  (simCloudManagerPool-4856-thread-28) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 379437 DEBUG (simCloudManagerPool-4856-thread-28) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=52
   [junit4]   2> 379437 DEBUG (simCloudManagerPool-4856-thread-28) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 52
   [junit4]   2> 379437 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 8 :
   [junit4]   2> 379437 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 379437 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=53
   [junit4]   2> 379438 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 53
   [junit4]   2> 379438 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 379438 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 379439 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379459 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379480 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379500 DEBUG (ScheduledTrigger-4857-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379520 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379539 DEBUG (simCloudManagerPool-4856-thread-29) [     ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node52":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n51",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 379540 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379560 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379580 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379600 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379621 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379641 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379649 DEBUG (simCloudManagerPool-4856-thread-29) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=54
   [junit4]   2> 379650 DEBUG (simCloudManagerPool-4856-thread-29) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 54
   [junit4]   2> 379650 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 379650 DEBUG (simCloudManagerPool-4856-thread-30) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=55
   [junit4]   2> 379650 DEBUG (simCloudManagerPool-4856-thread-30) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 55
   [junit4]   2> 379651 INFO  (simCloudManagerPool-4856-thread-30) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 379651 INFO  (simCloudManagerPool-4856-thread-30) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 379661 DEBUG (ScheduledTrigger-4857-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 379661 DEBUG (simCloudManagerPool-4856-thread-30) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=56
   [junit4]   2> 379661 DEBUG (simCloudManagerPool-4856-thread-30) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 56
   [junit4]   2> 379661 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - RunSolrRequest	path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr)
   [junit4]   2> 379662 DEBUG (simCloudManagerPool-4856-thread-31) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=57
   [junit4]   2> 379662 DEBUG (simCloudManagerPool-4856-thread-31) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 57
   [junit4]   2> 379662 INFO  (simCloudManagerPool-4856-thread-31) [     ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new replica of shard shard1 for collection testCollection
   [junit4]   2> 379662 INFO  (simCloudManagerPool-4856-thread-31) [     ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 379672 DEBUG (simCloudManagerPool-4856-thread-31) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=58
   [junit4]   2> 379673 DEBUG (simCloudManagerPool-4856-thread-31) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 58
   [junit4]   2> 379673 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario    * iter 9 :
   [junit4]   2> 379673 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - CalculateSuggestions	)
   [junit4]   2> 379673 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=59
   [junit4]   2> 379673 DEBUG (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 59
   [junit4]   2> 379674 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 379674 INFO  (TEST-TestSimScenario.testSuggestions-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario      - ApplySuggestions	)
   [junit4]   2> 379681 DEBUG (ScheduledTrigger-4857-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and l

[...truncated too long message...]

.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382427 DEBUG (ScheduledTrigger-4875-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382448 DEBUG (ScheduledTrigger-4875-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382468 DEBUG (ScheduledTrigger-4875-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382488 DEBUG (ScheduledTrigger-4875-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382508 DEBUG (ScheduledTrigger-4875-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382528 DEBUG (ScheduledTrigger-4875-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382549 DEBUG (ScheduledTrigger-4875-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382569 DEBUG (ScheduledTrigger-4875-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382589 DEBUG (ScheduledTrigger-4875-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382609 DEBUG (ScheduledTrigger-4875-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382629 DEBUG (ScheduledTrigger-4875-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382650 DEBUG (ScheduledTrigger-4875-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382670 DEBUG (ScheduledTrigger-4875-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382690 DEBUG (ScheduledTrigger-4875-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382710 DEBUG (ScheduledTrigger-4875-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382731 DEBUG (ScheduledTrigger-4875-thread-3) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382751 DEBUG (ScheduledTrigger-4875-thread-4) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 382758 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 9.	WaitEvent	trigger=indexSizeTrigger&wait=60
   [junit4]   2> 382759 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		WaitEvent	trigger=indexSizeTrigger&wait=60
   [junit4]   2> 382759 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 10.	Assert	condition=not_null&key=_trigger_event_indexSizeTrigger
   [junit4]   2> 382759 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		Assert	condition=not_null&key=_trigger_event_indexSizeTrigger
   [junit4]   2> 382760 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 11.	Assert	condition=equals&key=_trigger_event_indexSizeTrigger/eventType&expected=INDEXSIZE
   [junit4]   2> 382760 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		Assert	condition=equals&key=_trigger_event_indexSizeTrigger/eventType&expected=INDEXSIZE
   [junit4]   2> 382760 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 12.	Assert	condition=equals&key=_trigger_event_indexSizeTrigger/properties/requestedOps[0]/action&expected=SPLITSHARD
   [junit4]   2> 382760 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		Assert	condition=equals&key=_trigger_event_indexSizeTrigger/properties/requestedOps[0]/action&expected=SPLITSHARD
   [junit4]   2> 382760 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 13.	WaitCollection	collection=testCollection&shards=6&withInactive=true&requireLeaders=false&replicas=2
   [junit4]   2> 382760 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.s.SimScenario 		WaitCollection	collection=testCollection&shards=6&withInactive=true&requireLeaders=false&replicas=2
   [junit4]   2> 382762 INFO  (Simulated OverseerAutoScalingTriggerThread) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 382762 DEBUG (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 382762 DEBUG (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 382762 DEBUG (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 382762 DEBUG (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 382762 DEBUG (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 382762 DEBUG (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 382763 INFO  (TEST-TestSimScenario.testIndexing-seed#[EBFB7E1463924708]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testIndexing
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.sim.TestSimScenario_EBFB7E1463924708-001
   [junit4]   2> NOTE: test params are: codec=Lucene84, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@24f2bee5), locale=lrc-IR, timezone=Asia/Novosibirsk
   [junit4]   2> NOTE: Linux 5.3.0-51-generic amd64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=16,threads=1,free=92709232,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [HDFSCollectionsAPITest, DistributedExpandComponentTest, TestPrepRecovery, SolrJmxReporterTest, OrderedExecutorTest, HttpSolrCallGetCoreTest, AnalyticsQueryTest, AtomicUpdatesTest, TestReloadAndDeleteDocs, ClusterStateTest, ZkSolrClientTest, TestSolrJacksonAnnotation, OverriddenZkACLAndCredentialsProvidersTest, TestReloadDeadlock, PreAnalyzedFieldManagedSchemaCloudTest, SampleTest, TestDelegationWithHadoopAuth, RegexBytesRefFilterTest, TestDeleteCollectionOnDownNodes, TestAnalyzeInfixSuggestions, DistributedFacetPivotWhiteBoxTest, BadComponentTest, TestEmbeddedSolrServerSchemaAPI, VMParamsZkACLAndCredentialsProvidersTest, MoveReplicaTest, TestDocBasedVersionConstraints, SplitShardTest, TestWaitForStateWithJettyShutdowns, TestRemoteStreaming, AssignBackwardCompatibilityTest, CloudMLTQParserTest, QueryElevationComponentTest, JSONWriterTest, TestReplicaProperties, ExecutePlanActionTest, PeerSyncWithLeaderTest, TestNumericRangeQuery32, BlobRepositoryCloudTest, TestHighFrequencyDictionaryFactory, DocumentBuilderTest, TestCopyFieldCollectionResource, FullSolrCloudDistribCmdsTest, CursorPagingTest, MetricsHistoryIntegrationTest, TestSimScenario]
   [junit4] Completed [236/908 (1!)] on J3 in 5.26s, 4 tests, 1 failure <<< FAILURES!

[...truncated 50186 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/3125/consoleText

[repro] Revision: 9d6c738ffce0c3164691f161ba8b92a615b1e062

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line:  ant test  -Dtestcase=TestSimScenario -Dtests.method=testSplitShard -Dtests.seed=EBFB7E1463924708 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lrc-IR -Dtests.timezone=Asia/Novosibirsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestSimScenario
[repro] ant compile-test

[...truncated 3462 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestSimScenario" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=EBFB7E1463924708 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lrc-IR -Dtests.timezone=Asia/Novosibirsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 96 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
[repro] Exiting with code 0

[...truncated 43 lines...]