You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/11/06 07:50:03 UTC

[JENKINS] Lucene-Solr-Tests-7.x - Build # 226 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/226/

No tests ran.

Build Log:
[...truncated 11777 lines...]
   [junit4] Suite: org.apache.solr.cloud.ShardSplitTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/init-core-data-001
   [junit4]   2> 266515 WARN  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=61 numCloses=61
   [junit4]   2> 266516 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 266517 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 266517 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 266530 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /j/n
   [junit4]   2> 266550 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 266550 INFO  (Thread-139) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 266550 INFO  (Thread-139) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 266552 ERROR (Thread-139) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 266659 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkTestServer start zk server on port:34914
   [junit4]   2> 266883 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 266916 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 266917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 266918 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 266919 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 266952 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 266954 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 266955 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 266956 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 266970 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 266989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 267043 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 267043 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f8fab080d0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 267810 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 267898 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@74710238{/j/n,null,AVAILABLE}
   [junit4]   2> 267917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@731fdda4{HTTP/1.1,[http/1.1]}{127.0.0.1:40999}
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @286428ms
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/control/data, replicaType=NRT, hostContext=/j/n, hostPort=40999, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores}
   [junit4]   2> 267937 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:12.887Z
   [junit4]   2> 268084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 268084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/solr.xml
   [junit4]   2> 268195 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 268195 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 268197 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 268305 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 269141 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 269142 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40999_j%2Fn
   [junit4]   2> 269142 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.Overseer Overseer (id=98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) starting
   [junit4]   2> 269217 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40999_j%2Fn
   [junit4]   2> 269315 INFO  (OverseerStateUpdate-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 270334 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 270424 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 270514 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 270516 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores
   [junit4]   2> 270963 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 270963 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34914/solr ready
   [junit4]   2> 271090 INFO  (qtp611766918-530) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40999_j%252Fn&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 271182 INFO  (OverseerThreadFactory-269-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 271391 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 271391 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 271579 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 272728 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 272835 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 273771 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 273953 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 273953 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 274011 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 274011 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 274047 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 274117 WARN  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 274482 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 274482 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 274483 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 274483 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 274484 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 274485 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@689b8ef6[control_collection_shard1_replica_n1] main]
   [junit4]   2> 274502 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 274503 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 274503 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 274505 INFO  (searcherExecutor-272-thread-1-processing-n:127.0.0.1:40999_j%2Fn x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@689b8ef6[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 274505 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290913343406080
   [junit4]   2> 274539 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 274539 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 274539 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40999/j/n/control_collection_shard1_replica_n1/
   [junit4]   2> 274540 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 274540 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:40999/j/n/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 274540 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 274575 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40999/j/n/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 274613 INFO  (zkCallback-82-thread-2-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 274628 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 274629 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3238
   [junit4]   2> 274649 INFO  (qtp611766918-530) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 274760 INFO  (zkCallback-82-thread-3-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 275360 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 275653 INFO  (qtp611766918-530) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40999_j%252Fn&wt=javabin&version=2} status=0 QTime=4563
   [junit4]   2> 275800 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 275801 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34914/solr ready
   [junit4]   2> 275801 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 275803 INFO  (qtp611766918-531) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 275857 INFO  (OverseerThreadFactory-269-thread-2-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 275857 WARN  (OverseerThreadFactory-269-thread-2-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 276078 INFO  (qtp611766918-531) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 276079 INFO  (qtp611766918-531) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=276
   [junit4]   2> 276093 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 276987 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001 of type TLOG
   [junit4]   2> 276988 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@142bd175{/j/n,null,AVAILABLE}
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@410a7614{HTTP/1.1,[http/1.1]}{127.0.0.1:40610}
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @295481ms
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/j/n, hostPort=40610, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores}
   [junit4]   2> 276989 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:21.940Z
   [junit4]   2> 277080 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 277080 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/solr.xml
   [junit4]   2> 277084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 277084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 277102 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 277119 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 277609 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 277643 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 277645 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40610_j%2Fn
   [junit4]   2> 277645 INFO  (zkCallback-90-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 277696 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 277703 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 278082 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 278140 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 278140 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 278155 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores
   [junit4]   2> 278448 INFO  (qtp397310241-578) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40610_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 278560 INFO  (OverseerThreadFactory-269-thread-3-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40610_j%2Fn for creating new replica
   [junit4]   2> 278614 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 278632 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 278813 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 279844 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 279955 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 280792 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 280908 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 280962 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 280962 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 280962 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 280965 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 281106 WARN  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 281636 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 281636 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 281637 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 281637 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 281691 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 281706 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ed760e1[collection1_shard2_replica_t41] main]
   [junit4]   2> 281708 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 281708 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 281709 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 281710 INFO  (searcherExecutor-283-thread-1-processing-n:127.0.0.1:40610_j%2Fn x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@6ed760e1[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 281763 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290920953970688
   [junit4]   2> 281780 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 281780 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 281781 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/
   [junit4]   2> 281781 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 281782 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 281782 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 281782 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 281817 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 281893 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 281925 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 281927 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=3312
   [junit4]   2> 281967 INFO  (qtp397310241-578) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40610_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=3518
   [junit4]   2> 282076 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 282589 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 283770 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001 of type TLOG
   [junit4]   2> 283771 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 283857 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@25354843{/j/n,null,AVAILABLE}
   [junit4]   2> 283858 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6015987a{HTTP/1.1,[http/1.1]}{127.0.0.1:40217}
   [junit4]   2> 283858 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @302349ms
   [junit4]   2> 283858 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/j/n, hostPort=40217, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores}
   [junit4]   2> 283858 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 284227 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 284263 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 284263 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 284263 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:29.213Z
   [junit4]   2> 284459 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 284459 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/solr.xml
   [junit4]   2> 284462 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 284462 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 284483 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 284626 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 284917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 284952 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 285012 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40217_j%2Fn
   [junit4]   2> 285013 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285048 INFO  (zkCallback-90-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285013 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285276 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285554 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 285921 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 285921 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 285923 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores
   [junit4]   2> 286413 INFO  (qtp260274602-607) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40217_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 286578 INFO  (OverseerThreadFactory-269-thread-4-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40217_j%2Fn for creating new replica
   [junit4]   2> 286702 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 286702 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 286740 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 286741 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 287875 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 288043 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 288989 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 289146 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 289264 WARN  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 289648 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 289648 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 289649 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 289649 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 289650 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 289684 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@596f7a34[collection1_shard1_replica_t43] main]
   [junit4]   2> 289699 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 289700 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 289700 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 289700 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290929276518400
   [junit4]   2> 289883 INFO  (searcherExecutor-294-thread-1-processing-n:127.0.0.1:40217_j%2Fn x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@596f7a34[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40217/j/n/collection1_shard1_replica_t43/
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:40217/j/n/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 289922 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40217/j/n/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 289939 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 289963 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 289976 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 290001 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=3299
   [junit4]   2> 290106 INFO  (qtp260274602-607) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40217_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=3694
   [junit4]   2> 290123 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290129 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290497 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 291353 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001 of type TLOG
   [junit4]   2> 291354 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 291501 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@399184bb{/j/n,null,AVAILABLE}
   [junit4]   2> 291534 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3a749460{HTTP/1.1,[http/1.1]}{127.0.0.1:39030}
   [junit4]   2> 291534 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @310026ms
   [junit4]   2> 291534 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/j/n, hostPort=39030, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores}
   [junit4]   2> 291535 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 291535 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 291535 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 291535 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 291536 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:36.485Z
   [junit4]   2> 291828 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 291828 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/solr.xml
   [junit4]   2> 291917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 291917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 291919 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 292047 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 292340 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 292358 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 292359 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39030_j%2Fn
   [junit4]   2> 292376 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292466 INFO  (zkCallback-90-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292486 INFO  (zkCallback-107-thread-1-processing-n:127.0.0.1:39030_j%2Fn) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292450 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292450 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 293038 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 293090 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 293110 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 293111 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores
   [junit4]   2> 293602 INFO  (qtp1728082934-636) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39030_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 293712 INFO  (OverseerThreadFactory-269-thread-5-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:39030_j%2Fn for creating new replica
   [junit4]   2> 293717 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 293717 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 293735 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 293735 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 293735 INFO  (zkCallback-107-thread-1-processing-n:127.0.0.1:39030_j%2Fn) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 294848 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 294937 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 295576 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 295738 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 295739 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 295739 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 295739 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 295796 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 295852 WARN  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 296201 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 296201 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 296275 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 296275 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 296276 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 296326 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@4089d148[collection1_shard2_replica_t45] main]
   [junit4]   2> 296328 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 296328 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 296329 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 296347 INFO  (searcherExecutor-305-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@4089d148[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 296347 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290936246403072
   [junit4]   2> 296366 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 296367 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2649
   [junit4]   2> 296384 INFO  (updateExecutor-104-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 296420 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:39030/j/n/collection1_shard2_replica_t45/]
   [junit4]   2> 296459 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 296459 INFO  (zkCallback-107-thread-1-processing-n:127.0.0.1:39030_j%2Fn) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 296459 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 296474 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:40610/j/n]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:39030_j%252Fn&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 296475 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 296476 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:39030_j%2Fn, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:39030/j/n","node_name":"127.0.0.1:39030_j%2Fn","state":"recovering","type":"TLOG"}
   [junit4]   2> 296476 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
   [junit4]   2> 296476 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:39030_j%252Fn&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 296494 INFO  (qtp1728082934-636) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39030_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=2892
   [junit4]   2> 296496 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 297022 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
   [junit4]   2> 297022 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/].
   [junit4]   2> 297169 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1583290937108332544,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 297170 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 297172 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 297172 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_t41]  webapp=/j/n path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}{commit=} 0 147
   [junit4]   2> 297338 INFO  (qtp397310241-575) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.c.S.Request [collection1_shard2_replica_t41]  webapp=/j/n path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 297352 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 297409 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 297409 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3bc3422f commitCommandVersion:0
   [junit4]   2> 297608 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b4e375f[collection1_shard2_replica_t45] main]
   [junit4]   2> 297609 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 297611 INFO  (searcherExecutor-305-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@5b4e375f[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 297627 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Replication Recovery was successful.
   [junit4]   2> 297627 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
   [junit4]   2> 297681 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 starting background replication from leader
   [junit4]   2> 297681 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 297705 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 297705 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 297706 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:

[...truncated too long message...]

ava
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/PHPSerializedResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/PythonResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/QueryResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/QueryResponseWriterUtil.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/RawResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/ResultContext.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/RetrieveFieldsOptimizer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/RubyResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SchemaXmlResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SchemaXmlWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SmileResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SolrQueryResponse.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/TextResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/WriteableValue.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/XMLResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/XMLWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/XSLTResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/BaseEditorialTransformer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ChildDocTransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/DocIdAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/DocTransformer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/DocTransformers.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ElevatedMarkerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ExcludedMarkerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ExplainAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/GeoTransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/RawValueTransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/RenameFieldTransformer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ScoreAugmenter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ShardAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/SubQueryAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/TransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ValueAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ValueSourceAugmenter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/WriteableGeoJSON.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/BaseSolrResource.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/DELETEable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/GETable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/ManagedResource.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/ManagedResourceObserver.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/ManagedResourceStorage.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/POSTable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/PUTable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/RestManager.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/SolrSchemaRestApi.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/FieldTypeXmlAdapter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/BaseManagedTokenFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedStopFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedSynonymFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedSynonymGraphFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedWordSetResource.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractEnumField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractSpatialFieldType.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractSpatialPrefixTreeFieldType.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractSubTypeFieldType.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/BBoxField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/BinaryField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/BoolField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/ClassicIndexSchemaFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/CollationField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/CoordinateFieldType.java

[JENKINS] Lucene-Solr-Tests-7.x - Build # 228 - Still Unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/228/

5 tests failed.
FAILED:  org.apache.solr.cloud.CleanupOldIndexTest.test

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:EC32E654A50BFA91]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:440)
	at org.apache.solr.cloud.CleanupOldIndexTest.test(CleanupOldIndexTest.java:114)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.test

Error Message:
Could not load collection from ZK: customcollreplicadeletion

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: customcollreplicadeletion
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:EC32E654A50BFA91]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
	at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
	at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.test(DeleteLastCustomShardedReplicaTest.java:43)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/customcollreplicadeletion/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
	... 44 more


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration

Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:41821_solr wasn't created

Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:41821_solr wasn't created
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:7CDC518205C25A86]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:914)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication

Error Message:
Index: 0, Size: 0

Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:702E82DB28F02A77]:0)
	at java.util.ArrayList.rangeCheck(ArrayList.java:657)
	at java.util.ArrayList.get(ArrayList.java:433)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:9D2B4A213782DAE3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11723 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/init-core-data-001
   [junit4]   2> 566409 WARN  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 566409 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 566437 INFO  (Thread-813) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 566437 INFO  (Thread-813) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 566462 ERROR (Thread-813) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 566525 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46206
   [junit4]   2> 566614 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 566615 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 566616 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d285829{/solr,null,AVAILABLE}
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5e669453{HTTP/1.1,[http/1.1]}{127.0.0.1:41147}
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.Server Started @581971ms
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41147}
   [junit4]   2> 566617 ERROR (jetty-launcher-268-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.2.0
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-07T01:33:51.500Z
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4be495bf{/solr,null,AVAILABLE}
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1329a9be{HTTP/1.1,[http/1.1]}{127.0.0.1:45056}
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.Server Started @581973ms
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45056}
   [junit4]   2> 566618 ERROR (jetty-launcher-268-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.2.0
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 566619 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 566619 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-07T01:33:51.502Z
   [junit4]   2> 566651 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 566651 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 566671 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46206/solr
   [junit4]   2> 566687 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f941cb9610001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 566689 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46206/solr
   [junit4]   2> 566825 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 566826 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45056_solr
   [junit4]   2> 566827 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.Overseer Overseer (id=98960567915577349-127.0.0.1:45056_solr-n_0000000000) starting
   [junit4]   2> 566917 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45056_solr
   [junit4]   2> 566917 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 566918 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 566918 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: []
   [junit4]   2> 566918 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 566919 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 566919 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 567006 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 567007 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 567008 DEBUG (ScheduledTrigger-606-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:45056_solr]
   [junit4]   2> 567130 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 567131 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 567146 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41147_solr
   [junit4]   2> 567161 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 567202 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 567295 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567347 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567348 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567381 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node1/.
   [junit4]   2> 567510 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567551 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567569 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567584 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node2/.
   [junit4]   2> 568003 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 568040 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 568121 DEBUG (ScheduledTrigger-606-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr]
   [junit4]   2> 568181 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger
   [junit4]   2> 568211 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 568215 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 568215 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 568268 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 568268 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 568269 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 568529 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 568530 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 568673 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=38
   [junit4]   2> 568688 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 568699 DEBUG (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 568727 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f941cb9610009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 568727 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=342
   [junit4]   2> 568728 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 568730 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr]
   [junit4]   2> 568730 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=3, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 568731 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 568745 INFO  (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 568746 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 568801 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1bc4fd93{/solr,null,AVAILABLE}
   [junit4]   2> 568747 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 568837 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr]
   [junit4]   2> 568853 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 568874 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@58ad1001{HTTP/1.1,[http/1.1]}{127.0.0.1:34491}
   [junit4]   2> 568874 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.Server Started @584229ms
   [junit4]   2> 568874 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34491}
   [junit4]   2> 568874 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.2.0
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-07T01:33:53.759Z
   [junit4]   2> 568890 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 568893 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 568947 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46206/solr
   [junit4]   2> 568986 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 568987 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 569023 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34491_solr
   [junit4]   2> 569040 INFO  (zkCallback-295-thread-1-processing-n:127.0.0.1:34491_solr) [n:127.0.0.1:34491_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569040 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569053 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569074 INFO  (zkCallback-287-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569343 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34491.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 569380 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34491.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 569380 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34491.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 569381 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node3/.
   [junit4]   2> 569891 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 569891 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 569891 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:34491_solr at time 1510018434774000000
   [junit4]   2> 570892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 570892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 571892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 571892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 572898 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 572898 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 572898 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:34491_solr] added at times [1510018434774000000], now=1510018437781000000
   [junit4]   2> 572899 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"14f4a9c418fee180T733qudz06w4autesi7g8e4im5",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":1510018434774000000,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1510018434774000000],
   [junit4]   2>     "nodeNames":["127.0.0.1:34491_solr"]}}
   [junit4]   2> 572901 INFO  (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 572957 DEBUG (AutoscalingActionExecutor-607-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"14f4a9c418fee180T733qudz06w4autesi7g8e4im5",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":1510018434774000000,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1510018434774000000],
   [junit4]   2>     "_enqueue_time_":1510018437783000000,
   [junit4]   2>     "nodeNames":["127.0.0.1:34491_solr"]}}
   [junit4]   2> 573056 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 573085 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 573110 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 573130 INFO  (qtp1816015907-2215) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 573131 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 573132 DEBUG (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 573150 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=178
   [junit4]   2> 573151 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 573151 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 573151 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=3, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 573162 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 573162 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 573162 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 573973 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 573973 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 574988 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 574988 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 575155 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAddedTrigger
   [junit4]   2> 575298 INFO  (TEST-TriggerIntegrationTest.testSearchRate-seed#[6466D98E0BF79769]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSearchRate
   [junit4]   2> 575310 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 575317 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 575317 INFO  (TEST-TriggerIntegrationTest.testSearchRate-seed#[6466D98E0BF79769]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 5
   [junit4]   2> 575334 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 575334 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 575334 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 575336 INFO  (qtp1816015907-2211) [n:127.0.0.1:34491_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=collection1&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 575411 INFO  (OverseerThreadFactory-608-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 575547 INFO  (OverseerStateUpdate-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41147/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 575581 INFO  (OverseerStateUpdate-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45056/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 575845 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 575846 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 575866 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 575866 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 576025 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576025 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576040 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576081 INFO  (zkCallback-279-thread-2-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576921 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 576972 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 576987 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 576987 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true
   [junit4]   2> 576988 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 576988 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 576988 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node2/collection1_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node2/./collection1_shard1_replica_n1/data/]
   [junit4]   2> 577009 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 577117 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema [collection1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 577120 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 577120 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from collection collection1, trusted=true
   [junit4]   2> 577171 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 577189 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 577190 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node1/collection1_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node1/./collection1_shard1_replica_n2/data/]
   [junit4]   2> 577786 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 577786 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 577787 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 577787 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 577871 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ab65fb3[collection1_shard1_replica_n1] main]
   [junit4]   2> 577872 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 577872 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 577873 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 577873 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583369098631315456
   [junit4]   2> 577916 INFO  (searcherExecutor-619-thread-1-processing-n:127.0.0.1:41147_solr x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@2ab65fb3[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 577919 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 577919 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 577946 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 577951 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 577951 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 577969 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@52efb49e[collection1_shard1_replica_n2] main]
   [junit4]   2> 578021 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 578054 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 578054 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 578055 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583369098822156288
   [junit4]   2> 578063 INFO  (searcherExecutor-620-thread-1-processing-n:127.0.0.1:45056_solr x:collection1_shard1_replica_n2 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [collection1_shard1_replica_n2] Registered new searcher Searcher@52efb49e[collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 578151 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578152 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578152 INFO  (zkCallback-279-thread-2-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578152 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41147/solr/collection1_shard1_replica_n1/
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n1 url=http://127.0.0.1:41147/solr START replicas=[http://127.0.0.1:45056/solr/collection1_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 578479 INFO  (qtp25604371-2166) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=13
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n1 url=http://127.0.0.1:41147/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 578761 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41147/solr/collection1_shard1_replica_n1/ shard1
   [junit4]   2> 578862 INFO  (zkCallback-279-thread-3-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578862 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578867 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578867 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578911 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 578913 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3067
   [junit4]   2> 579018 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579018 INFO  (zkCallback-279-thread-3-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579018 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579018 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579059 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3193
   [junit4]   2> 579141 INFO  (qtp1816015907-2211) [n:127.0.0.1:34491_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 579206 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579206 INFO  (zkCallback-279-thread-3-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579217 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579217 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579650 INFO  (OverseerCollectionConfigSetProcessor-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 580173 INFO  (qtp1816015907-2211) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=collection1&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=4837
   [junit4]   2> 580225 INFO  (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 580279 INFO  (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 580371 INFO  (qtp25604371-2149) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=52
   [junit4]   2> 580462 INFO  (qtp1816015907-2216) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 580480 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=1
   [junit4]   2> 580499 DEBUG (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 580535 INFO  (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=353
   [junit4]   2> 580560 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 580600 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 580715 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 580716 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 580779 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 580790 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=72
   [junit4]   2> 580795 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 580853 INFO  (qtp1816015907-2213) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 580865 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 580881 DEBUG (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 580884 INFO  (qtp25604371-2163) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=18
   [junit4]   2> 580897 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 580954 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 580962 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=393
   [junit4]   2> 580975 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581048 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=127.0.0.1:41147_solr, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581048 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=127.0.0.1:45056_solr, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581072 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 581084 INFO  (qtp2037470-2161) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=107
   [junit4]   2> 581085 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581085 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581086 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581087 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581087 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581096 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 581196 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581217 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 581236 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 581254 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 581285 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=collection1.collection1_shard1_replica_n2, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581285 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=collection1.collection1_shard1_replica_n1, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581285 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=collection1.shard1, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581304 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=70
   [junit4]   2> 581305 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581306 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581306 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581319 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581320 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581321 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581321 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581322 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581322 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581356 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=32
   [junit4]   2> 581358 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581358 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581359 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581376 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&versi

[...truncated too long message...]

r registry=solr.collection.collection1.shard1.leader, tag=1484212806
   [junit4]   2> 5047168 INFO  (coreCloseExecutor-6289-thread-3) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard4 r:core_node16 x:routeFieldColl_shard4_replica_n9] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.routeFieldColl.shard4.leader, tag=1831975278
   [junit4]   2> 5047168 INFO  (coreCloseExecutor-6289-thread-4) [n:127.0.0.1:39409_o_mu%2Fs c:splitByRouteKeyTest s:shard3 r:core_node11 x:splitByRouteKeyTest_shard3_replica_n8] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.splitByRouteKeyTest.shard3.leader, tag=1745759969
   [junit4]   2> 5047204 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.s.c.Overseer Overseer (id=98960850096029714-127.0.0.1:39409_o_mu%2Fs-n_0000000004) closing
   [junit4]   2> 5047204 INFO  (OverseerStateUpdate-98960850096029714-127.0.0.1:39409_o_mu%2Fs-n_0000000004) [n:127.0.0.1:39409_o_mu%2Fs    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:39409_o_mu%2Fs
   [junit4]   2> 5047242 WARN  (OverseerAutoScalingTriggerThread-98960850096029714-127.0.0.1:39409_o_mu%2Fs-n_0000000004) [n:127.0.0.1:39409_o_mu%2Fs    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 5047516 WARN  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 5047516 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.c.SolrCore [routeFieldColl_shard2_replica_n3]  CLOSING SolrCore org.apache.solr.core.SolrCore@5f717e63
   [junit4]   2> 5047516 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.routeFieldColl.shard2.replica_n3, tag=1601273443
   [junit4]   2> 5047517 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2729f778: rootName = null, domain = solr.core.routeFieldColl.shard2.replica_n3, service url = null, agent id = null] for registry solr.core.routeFieldColl.shard2.replica_n3 / com.codahale.metrics.MetricRegistry@6f756884
   [junit4]   2> 5047569 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.routeFieldColl.shard2.leader, tag=1601273443
   [junit4]   2> 5047659 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@40e0dcf7{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 5047659 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@c0aae6a{/o_mu/s,null,UNAVAILABLE}
   [junit4]   2> 5047693 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.s.c.ChaosMonkey monkey: stop jetty! 38762
   [junit4]   2> 5047693 ERROR (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 5047695 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40639 40639
   [junit4]   2> 5047817 INFO  (Thread-4150) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40639 40639
   [junit4]   2> 5047819 WARN  (Thread-4150) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/collections/routeFieldColl/state.json
   [junit4]   2> 	10	/solr/aliases.json
   [junit4]   2> 	10	/solr/collections/splitByRouteKeyTest/state.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	4	/solr/collections/collection1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/clusterprops.json
   [junit4]   2> 	10	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/live_nodes
   [junit4]   2> 	10	/solr/collections
   [junit4]   2> 	5	/solr/overseer/queue
   [junit4]   2> 	5	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	5	/solr/overseer/collection-queue-work
   [junit4]   2> 	5	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6466D98E0BF79769-001
   [junit4]   2> Nov 07, 2017 2:48:32 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=Lucene50(blocksize=128), shard_s=FSTOrd50, a_t=FSTOrd50, id=Lucene50(blocksize=128)}, docValues:{rnd_b=DocValuesFormat(name=Lucene70), shard_s=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Direct), n_ti=DocValuesFormat(name=Direct), a_t=DocValuesFormat(name=Direct), a_i=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=495, maxMBSortInHeap=6.831173433073789, sim=RandomSimilarity(queryNorm=true): {}, locale=en-US, timezone=Europe/Kiev
   [junit4]   2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=249381456,total=522190848
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudNestedDocsSort, ConjunctionSolrSpellCheckerTest, WrapperMergePolicyFactoryTest, ClassificationUpdateProcessorFactoryTest, TestMultiValuedNumericRangeQuery, TestFieldTypeCollectionResource, TestSurroundQueryParser, TestReplicaProperties, DeleteShardTest, SimpleMLTQParserTest, BufferStoreTest, DistributedFacetPivotLongTailTest, ChaosMonkeySafeLeaderWithPullReplicasTest, MoveReplicaHDFSFailoverTest, TestLeaderElectionZkExpiry, TestSSLRandomization, TriggerIntegrationTest, TestStressLucene, TestBinaryResponseWriter, TestMaxTokenLenTokenizer, TestManagedSynonymFilterFactory, TestConfigReload, TestHighFrequencyDictionaryFactory, ReplicaListTransformerTest, ShardRoutingCustomTest, TestSolrCloudWithKerberosAlt, OutputWriterTest, SolrGraphiteReporterTest, MultiThreadedOCPTest, TestCursorMarkWithoutUniqueKey, AssignTest, HdfsCollectionsAPIDistributedZkTest, DebugComponentTest, TestQuerySenderNoQuery, MergeStrategyTest, TestWriterPerf, TestLazyCores, HdfsDirectoryFactoryTest, ShowFileRequestHandlerTest, HttpPartitionTest, TestNumericTerms64, HdfsBasicDistributedZkTest, PeerSyncWithIndexFingerprintCachingTest, TestSizeLimitedDistributedMap, DOMUtilTest, DistributedTermsComponentTest, SuggesterTSTTest, TestEmbeddedSolrServerAdminHandler, TestCollectionAPI, PingRequestHandlerTest, TestXmlQParser, SuggesterFSTTest, TestConfigOverlay, TestInitQParser, DeleteLastCustomShardedReplicaTest, TestDocSet, TestRandomFlRTGCloud, HdfsWriteToMultipleCollectionsTest, TestFieldCacheWithThreads, HdfsRecoveryZkTest, CircularListTest, NotRequiredUniqueKeyTest, TestJsonFacets, RollingRestartTest, BlockJoinFacetRandomTest, TestConfigsApi, TestDynamicFieldResource, TestJettySolrRunner, TestPKIAuthenticationPlugin, TestCloudSchemaless, SolrRequestParserTest, TestExpandComponent, ManagedSchemaRoundRobinCloudTest, CdcrRequestHandlerTest, TestFaceting, TestConfigSetsAPIExclusivity, PathHierarchyTokenizerFactoryTest, ParsingFieldUpdateProcessorsTest, PolyFieldTest, RequestHandlersTest, TestPseudoReturnFields, DirectUpdateHandlerTest, ZkCLITest, SpatialRPTFieldTypeTest, TestReqParamsAPI, MBeansHandlerTest, TestScoreJoinQPScore, TestSQLHandlerNonCloud, LukeRequestHandlerTest, BasicAuthStandaloneTest, RegexBytesRefFilterTest, DistributedSuggestComponentTest, PrimUtilsTest, TestSolr4Spatial, TestDynamicLoading, AutoAddReplicasIntegrationTest, CloudExitableDirectoryReaderTest, TestRetrieveFieldsOptimizer, SynonymTokenizerTest, SuggestComponentContextFilterQueryTest, TestNumericTokenStream, TestRangeQuery, ConvertedLegacyTest, TestBM25SimilarityFactory, CreateCollectionCleanupTest, TestAuthenticationFramework, SolrMetricReporterTest, TestConfigSets, ShardRoutingTest, SolrIndexSplitterTest, TestAnalyzedSuggestions, TestExactStatsCache, TestMissingGroups, TestManagedSchema, PeerSyncReplicationTest, HighlighterConfigTest, TestStandardQParsers, TestTrackingShardHandlerFactory, OverseerRolesTest, AddReplicaTest, OpenExchangeRatesOrgProviderTest, TestHashPartitioner, TestJoin, SolrCmdDistributorTest, PeerSyncTest, TestFiltering, SpellCheckCollatorTest, TestCSVLoader, TestAtomicUpdateErrorCases, TestRemoteStreaming, XsltUpdateRequestHandlerTest, DocumentAnalysisRequestHandlerTest, TermVectorComponentTest, RequiredFieldsTest, FastVectorHighlighterTest, TestJmxIntegration, UniqFieldsUpdateProcessorFactoryTest, UpdateParamsTest, ResponseLogComponentTest, TestStressRecovery, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnCommitTest, OverseerStatusTest, RestartWhileUpdatingTest, ShardSplitTest]
   [junit4] Completed [541/748 (5!)] on J1 in 469.42s, 5 tests, 1 failure <<< FAILURES!

[...truncated 47987 lines...]

[JENKINS] Lucene-Solr-Tests-7.x - Build # 227 - Still unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/227/

16 tests failed.
FAILED:  org.apache.solr.handler.dataimport.TestContentStreamDataSource.testCommitWithin

Error Message:
expected:<0> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<2>
	at __randomizedtesting.SeedInfo.seed([E652F1EA981F2225:5C809E921B31CC30]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.dataimport.TestContentStreamDataSource.testCommitWithin(TestContentStreamDataSource.java:98)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DistribCursorPagingTest.test

Error Message:
Error from server at http://127.0.0.1:55433/ydn/b/collection1_shard1_replica_n43: Cannot talk to ZooKeeper - Updates are disabled.

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:55433/ydn/b/collection1_shard1_replica_n43: Cannot talk to ZooKeeper - Updates are disabled.
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:541)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1008)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.indexDoc(AbstractFullDistribZkTestBase.java:839)
	at org.apache.solr.cloud.DistribCursorPagingTest.doRandomSortsOnLargeIndex(DistribCursorPagingTest.java:581)
	at org.apache.solr.cloud.DistribCursorPagingTest.test(DistribCursorPagingTest.java:93)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55433/ydn/b/collection1_shard1_replica_n43: Cannot talk to ZooKeeper - Updates are disabled.
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:518)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more


FAILED:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
KeeperErrorCode = Session expired for /clusterstate.json

Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:586)
	at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.test

Error Message:
Error from server at http://127.0.0.1:42803/qx/lh: KeeperErrorCode = Session expired for /overseer/collection-map-completed/mn-1001

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42803/qx/lh: KeeperErrorCode = Session expired for /overseer/collection-map-completed/mn-1001
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getStatusResponse(AbstractFullDistribZkTestBase.java:2241)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getRequestState(AbstractFullDistribZkTestBase.java:2234)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getRequestState(AbstractFullDistribZkTestBase.java:2230)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:178)
	at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:64)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.OverseerTaskQueueTest.testPeekElements

Error Message:
expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:A424B778EDFFDD03]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.DistributedQueueTest.testPeekElements(DistributedQueueTest.java:261)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.PeerSyncReplicationTest.test

Error Message:
KeeperErrorCode = Session expired for /clusterstate.json

Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:586)
	at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testCreateDelete {seed=[590A0D593DC6891E:F64C40E9FFF4BA02]}

Error Message:
Error from server at https://127.0.0.1:35030/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000012

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:35030/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000012
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:F64C40E9FFF4BA02]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.TestTlogReplica.testCreateDelete(TestTlogReplica.java:211)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=1742, name=testExecutor-768-thread-5, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1742, name=testExecutor-768-thread-5, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41183/rd/r: Another replica with the same core name already exists for this collection
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$0(BasicDistributedZkTest.java:593)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test

Error Message:
Trigger was not fired 

Stack Trace:
java.lang.AssertionError: Trigger was not fired 
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:151)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestSQLHandler.doTest

Error Message:
--> https://127.0.0.1:58366/collection1_shard2_replica_n41:Failed to execute sqlQuery 'select id from collection1 where id = 1 order by id asc' against JDBC connection 'jdbc:calcitesolr:'. Error while executing SQL "select id from collection1 where id = 1 order by id asc": java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

Stack Trace:
java.io.IOException: --> https://127.0.0.1:58366/collection1_shard2_replica_n41:Failed to execute sqlQuery 'select id from collection1 where id = 1 order by id asc' against JDBC connection 'jdbc:calcitesolr:'.
Error while executing SQL "select id from collection1 where id = 1 order by id asc": java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:FE4EB5FD507D9AA7]:0)
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:222)
	at org.apache.solr.handler.TestSQLHandler.getTuples(TestSQLHandler.java:2522)
	at org.apache.solr.handler.TestSQLHandler.testWhere(TestSQLHandler.java:368)
	at org.apache.solr.handler.TestSQLHandler.doTest(TestSQLHandler.java:83)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestSQLHandler

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.TestSQLHandler:     1) Thread[id=29274, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestSQLHandler]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestSQLHandler: 
   1) Thread[id=29274, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestSQLHandler]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E]:0)


FAILED:  org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:A0479EF601B3C494]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:DFCBF5B462975FFE]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrCore(TestTlogReplica.java:863)
	at org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates(TestTlogReplica.java:661)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:CF82CB11D55CCEE4]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrRunner(TestTlogReplica.java:898)
	at org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection(TestTlogReplica.java:644)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:98FA74F5109643B9]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrRunner(TestTlogReplica.java:898)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:533)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:450B70D44863F78D]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrCore(TestTlogReplica.java:863)
	at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:466)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11603 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTaskQueueTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTaskQueueTest_590A0D593DC6891E-001/init-core-data-001
   [junit4]   2> 360480 WARN  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=194 numCloses=194
   [junit4]   2> 360480 INFO  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 360481 INFO  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 364036 INFO  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 364062 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueueBlocking
   [junit4]   2> 364176 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 364216 INFO  (Thread-521) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 364216 INFO  (Thread-521) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 364822 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:60690
   [junit4]   2> 366381 ERROR (Thread-521) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 370027 WARN  (zkCallback-104-thread-2) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16848ba name: ZooKeeperConnection Watcher:127.0.0.1:60690/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 370028 WARN  (zkCallback-104-thread-2) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 371607 WARN  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]-SendThread(127.0.0.1:60690)) [    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15f9247a52d0000 has expired
   [junit4]   2> 371623 WARN  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16848ba name: ZooKeeperConnection Watcher:127.0.0.1:60690/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
   [junit4]   2> 371624 WARN  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 371624 WARN  (zkCallback-104-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 371730 INFO  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 371730 INFO  (zkCallback-104-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 371730 INFO  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Connected:true
   [junit4]   2> 373105 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueueBlocking
   [junit4]   2> 373106 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 373118 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60690 60690
   [junit4]   2> 373719 INFO  (Thread-521) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60690 60690
   [junit4]   2> 373720 WARN  (Thread-521) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/distqueue/test
   [junit4]   2> 
   [junit4]   2> 373723 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLeakChildWatcher
   [junit4]   2> 373724 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 373748 INFO  (Thread-522) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 373748 INFO  (Thread-522) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 373796 ERROR (Thread-522) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 374030 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:44574
   [junit4]   2> 374554 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLeakChildWatcher
   [junit4]   2> 374555 ERROR (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 374555 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44574 44574
   [junit4]   2> 374747 INFO  (Thread-522) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44574 44574
   [junit4]   2> 374760 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLocallyOffer
   [junit4]   2> 374761 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 374787 INFO  (Thread-523) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 374787 INFO  (Thread-523) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 374997 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:53781
   [junit4]   2> 375049 ERROR (Thread-523) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 377467 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLocallyOffer
   [junit4]   2> 377468 ERROR (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 377469 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53781 53781
   [junit4]   2> 377592 INFO  (Thread-523) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53781 53781
   [junit4]   2> 377600 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPeekElements
   [junit4]   2> 377600 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 377635 INFO  (Thread-524) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 377635 INFO  (Thread-524) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 377698 ERROR (Thread-524) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 377771 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:41123
   [junit4]   2> 380908 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPeekElements
   [junit4]   2> 381207 ERROR (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 381297 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41123 41123
   [junit4]   2> 381508 INFO  (Thread-524) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41123 41123
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTaskQueueTest -Dtests.method=testPeekElements -Dtests.seed=590A0D593DC6891E -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=de -Dtests.timezone=JST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 3.94s J0 | OverseerTaskQueueTest.testPeekElements <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1> but was:<0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:A424B778EDFFDD03]:0)
   [junit4]    > 	at org.apache.solr.cloud.DistributedQueueTest.testPeekElements(DistributedQueueTest.java:261)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 381550 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testContainsTaskWithRequestId
   [junit4]   2> 381551 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 381597 INFO  (Thread-525) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 381597 INFO  (Thread-525) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 381697 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:46467
   [junit4]   2> 381700 ERROR (Thread-525) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 382186 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testContainsTaskWithRequestId
   [junit4]   2> 382191 ERROR (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 382192 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46467 46467
   [junit4]   2> 382296 INFO  (Thread-525) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46467 46467
   [junit4]   2> 382331 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueue
   [junit4]   2> 382332 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 382363 INFO  (Thread-526) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 382363 INFO  (Thread-526) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 382448 ERROR (Thread-526) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 382463 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:36735
   [junit4]   2> 384715 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueue
   [junit4]   2> 384732 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 384732 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36735 36735
   [junit4]   2> 384912 INFO  (Thread-526) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36735 36735
   [junit4]   2> 384920 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueueCache
   [junit4]   2> 384920 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 385063 INFO  (Thread-529) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 385064 INFO  (Thread-529) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 385167 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:60893
   [junit4]   2> 385728 ERROR (Thread-529) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 387288 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueueCache
   [junit4]   2> 387299 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f9247f5b70000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 387300 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 387301 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60893 60893
   [junit4]   2> 387602 INFO  (Thread-529) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60893 60893
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTaskQueueTest_590A0D593DC6891E-001
   [junit4]   2> Nov 06, 2017 5:01:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=882, maxMBSortInHeap=6.723385164063693, sim=RandomSimilarity(queryNorm=true): {}, locale=de, timezone=JST
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=76574448,total=284688384
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandler, OverseerTaskQueueTest]
   [junit4] Completed [8/747 (1!)] on J0 in 28.12s, 7 tests, 1 failure <<< FAILURES!

[...truncated 109 lines...]
   [junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
   [junit4]   2> 911194 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.UnloadDistributedZkTest_590A0D593DC6891E-001/init-core-data-001
   [junit4]   2> 911195 WARN  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 911195 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 911217 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 911217 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /rd/r
   [junit4]   2> 911230 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 911233 INFO  (Thread-264) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 911233 INFO  (Thread-264) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 911284 ERROR (Thread-264) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 911334 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:53346
   [junit4]   2> 911493 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 911506 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 911507 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 911508 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 911516 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 911517 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 911517 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 911527 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-f

[...truncated too long message...]

junit4]   2> 171776 T65 oass.SolrDispatchFilter.logWelcomeBanner / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 171776 T65 oass.SolrDispatchFilter.logWelcomeBanner \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 171777 T65 oass.SolrDispatchFilter.logWelcomeBanner |___/\___/_|_|    Start time: 2017-11-06T20:37:15.887Z
   [junit4]   2> 171777 T65 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/solr.xml
   [junit4]   2> 171808 T65 oasc.SolrXmlConfig.getMetricReporterPluginInfos MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 172506 T65 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 172679 T65 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 172679 T65 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 172757 T65 oasc.CorePropertiesLocator.discover Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002
   [junit4]   2> 172765 T65 oasc.CorePropertiesLocator.discover Cores are: [collection1]
   [junit4]   2> 172824 T100 oasc.TransientSolrCoreCacheDefault.doInit Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 173275 T100 x:x:collection1 oasc.SolrConfig.<init> Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 173450 T100 x:x:collection1 oass.IndexSchema.readSchema [collection1] Schema name=dih_test
   [junit4]   2> 173592 T100 x:x:collection1 oass.IndexSchema.readSchema Loaded schema dih_test/4.0 with uniqueid field id
   [junit4]   2> 173592 T100 x:x:collection1 oasc.CoreContainer.createFromDescriptor Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1, trusted=true
   [junit4]   2> 173592 T100 x:x:collection1 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 173593 T100 x:x:collection1 oasc.SolrCore.initRecoveryStrategyBuilder solr.RecoveryStrategy.Builder
   [junit4]   2> 173593 T100 x:x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1/data/]
   [junit4]   2> 174287 T100 x:x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 174288 T100 x:x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 174376 T100 x:x:collection1 oass.SolrIndexSearcher.<init> Opening [Searcher@2c05f8f2[collection1] main]
   [junit4]   2> 174376 T100 x:x:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1/conf
   [junit4]   2> 174377 T100 x:x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000ms.
   [junit4]   2> 174379 T104 x:x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c05f8f2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@6303b63e
   [junit4]   2> 175016 T92 x:x:collection1 C7 oashd.DataImporter.maybeReloadConfiguration Loading DIH Configuration: data-config.xml
   [junit4]   2> 175018 T92 x:x:collection1 C7 oashd.DataImporter.loadDataConfig Data Configuration loaded successfully
   [junit4]   2> 175018 T92 x:x:collection1 C7 oashd.DataImporter.doFullImport Starting Full Import
   [junit4]   2> 175019 T92 x:x:collection1 C7 oashd.SimplePropertiesWriter.readIndexerProperties WARN Unable to read: dataimport.properties
   [junit4]   2> 175048 T92 x:x:collection1 C7 oashd.DocBuilder.finish Import completed successfully
   [junit4]   2> 175048 T92 x:x:collection1 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 175048 T92 x:x:collection1 C7 oasu.SolrIndexWriter.setCommitData Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7dd17df0 commitCommandVersion:0
   [junit4]   2> 175117 T92 x:x:collection1 C7 oass.SolrIndexSearcher.<init> Opening [Searcher@353e4d76[collection1] main]
   [junit4]   2> 175136 T92 x:x:collection1 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 175142 T104 x:x:collection1 C7 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@353e4d76[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):c2)))}
   [junit4]   2> 175171 T92 x:x:collection1 C7 oashd.SimplePropertiesWriter.readIndexerProperties WARN Unable to read: dataimport.properties
   [junit4]   2> 175172 T92 x:x:collection1 C7 oashd.SimplePropertiesWriter.persist Wrote last indexed time to dataimport.properties
   [junit4]   2> 175172 T92 x:x:collection1 C7 oashd.DocBuilder.execute Time taken = 0:0:0.152
   [junit4]   2> 175172 T92 x:x:collection1 C7 oasup.LogUpdateProcessorFactory$LogUpdateProcessor.finish [collection1]  webapp=/solr path=/dataimport params={clean=false&wt=javabin&version=2&command=full-import}{add=[1, 2],commit=} 0 155
   [junit4]   2> 175186 T93 x:x:collection1 C7 oasc.SolrCore.execute [collection1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=2 status=0 QTime=1
   [junit4]   2> 175208 T65 oejs.AbstractConnector.doStop Stopped ServerConnector@14eee448{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 175208 T65 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1795271940
   [junit4]   2> 175231 T65 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 175232 T65 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@34b449ab: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2e750bf1
   [junit4]   2> 175250 T65 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 175250 T65 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6a6b72ed: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5a79115b
   [junit4]   2> 175257 T65 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 175257 T65 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2a7b1b0: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4d1d089e
   [junit4]   2> 175291 T108 x:x:collection1 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6303b63e
   [junit4]   2> 175291 T108 x:x:collection1 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.core.collection1, tag=1661187646
   [junit4]   2> 175292 T108 x:x:collection1 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@24f96e0: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@51e9ce82
   [junit4]   2> 175488 T65 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@63001271{/solr,null,UNAVAILABLE}
   [junit4]   2> 175511 T65 oas.SolrTestCaseJ4.tearDown ###Ending testSimple
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=es-CR, timezone=America/St_Lucia
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=106455536,total=273678336
   [junit4]   2> NOTE: All tests run in this JVM: [TestFieldReader, TestDateFormatTransformer, TestVariableResolver, TestRegexTransformer, TestPlainTextEntityProcessor, TestXPathEntityProcessor, TestSimplePropertiesWriter, TestURLDataSource, TestWriterImpl, TestSqlEntityProcessorDelta, TestContentStreamDataSource]
   [junit4] Completed [25/38 (1!)] on J2 in 25.97s, 2 tests, 1 failure <<< FAILURES!

[...truncated 41751 lines...]