You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/05/18 06:00:22 UTC

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1924 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1924/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.update.TestHdfsUpdateLog.testFSThreadSafety

Error Message:
Captured an uncaught exception in thread: Thread[id=1934, name=Thread-379, state=RUNNABLE, group=TGRP-TestHdfsUpdateLog]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1934, name=Thread-379, state=RUNNABLE, group=TGRP-TestHdfsUpdateLog]
	at __randomizedtesting.SeedInfo.seed([6CDACEA730C11C07:9AF5695CFD6BB4F4]:0)
Caused by: org.apache.solr.common.SolrException: Exception writing document id 15 to the index; possible analysis error.
	at __randomizedtesting.SeedInfo.seed([6CDACEA730C11C07]:0)
	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246)
	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:67)
	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)
	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:950)
	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1163)
	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:633)
	at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103)
	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:261)
	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:188)
	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
	at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
	at org.apache.solr.util.TestHarness.update(TestHarness.java:284)
	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:281)
	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:251)
	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:863)
	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:842)
	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:836)
	at org.apache.solr.update.TestHdfsUpdateLog$2.run(TestHdfsUpdateLog.java:122)
Caused by: java.lang.NullPointerException
	at org.apache.solr.update.UpdateLog.getCurrentLogSizeFromStream(UpdateLog.java:299)
	at org.apache.solr.update.DirectUpdateHandler2.getCurrentTLogSize(DirectUpdateHandler2.java:1007)
	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291)
	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:234)
	... 20 more




Build Log:
[...truncated 12542 lines...]
   [junit4] Suite: org.apache.solr.update.TestHdfsUpdateLog
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001
   [junit4]   2> 113284 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 113284 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 113286 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 113286 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 113775 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 114372 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 114498 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Logging to org.apache.logging.slf4j.Log4jLogger@15e517c via org.mortbay.log.Slf4jLog
   [junit4]   2> 114526 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 114795 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 114832 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_39219_hdfs____mmpf2m/webapp
   [junit4]   2> 115614 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:39219
   [junit4]   2> 116441 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 116444 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 116456 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_45545_datanode____.x5i344/webapp
   [junit4]   2> 116942 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45545
   [junit4]   2> 117209 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 117210 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 117223 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_44099_datanode____2iaawn/webapp
   [junit4]   2> 117746 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44099
   [junit4]   2> 117787 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:38397) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 117916 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:38397) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 117958 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x6b2d817e41563: from storage DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17 node DatanodeRegistration(127.0.0.1:44993, datanodeUuid=70a2a464-d9b9-4bea-860e-902e70855e2b, infoPort=40857, infoSecurePort=0, ipcPort=37551, storageInfo=lv=-56;cid=testClusterID;nsid=573211689;c=0), blocks: 0, hasStaleStorage: true, processing time: 3 msecs
   [junit4]   2> 117959 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x6b2d817e41506: from storage DS-26f81c26-f8fa-404c-be8b-1fa438641e82 node DatanodeRegistration(127.0.0.1:38387, datanodeUuid=e3183cd3-8aaa-48d0-9c08-ba2216e08253, infoPort=41023, infoSecurePort=0, ipcPort=38539, storageInfo=lv=-56;cid=testClusterID;nsid=573211689;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
   [junit4]   2> 117959 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x6b2d817e41563: from storage DS-5e66c235-245f-49fc-96f6-5d16885fd6b5 node DatanodeRegistration(127.0.0.1:44993, datanodeUuid=70a2a464-d9b9-4bea-860e-902e70855e2b, infoPort=40857, infoSecurePort=0, ipcPort=37551, storageInfo=lv=-56;cid=testClusterID;nsid=573211689;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 117959 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x6b2d817e41506: from storage DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048 node DatanodeRegistration(127.0.0.1:38387, datanodeUuid=e3183cd3-8aaa-48d0-9c08-ba2216e08253, infoPort=41023, infoSecurePort=0, ipcPort=38539, storageInfo=lv=-56;cid=testClusterID;nsid=573211689;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 118439 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 118440 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 118478 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 118502 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 118631 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 118692 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@745617
   [junit4]   2> 118700 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@745617
   [junit4]   2> 118700 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@745617
   [junit4]   2> 118709 INFO  (coreLoadExecutor-410-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 118710 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 118735 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 118750 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 118894 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 118899 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 118899 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@745617
   [junit4]   2> 118907 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:38397/solr_hdfs_home
   [junit4]   2> 118907 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 118907 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 118907 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[hdfs://localhost.localdomain:38397/solr_hdfs_home/collection1//home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001/]
   [junit4]   2> 118908 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:38397/solr_hdfs_home/collection1//home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001/snapshot_metadata
   [junit4]   2> 118923 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 118923 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 118923 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 119393 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 119399 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:38397/solr_hdfs_home/collection1//home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001
   [junit4]   2> 119425 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:38397/solr_hdfs_home/collection1//home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001/index
   [junit4]   2> 119431 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 119431 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 119431 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 119438 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 119438 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=35.3759765625, floorSegmentMB=1.4580078125, forceMergeDeletesPctAllowed=7.488416178086012, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.45341706742409493
   [junit4]   2> 119666 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW]]} size 69
   [junit4]   2> 119666 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741825_1001 size 69
   [junit4]   2> 120075 WARN  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 120116 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 120116 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=hdfs://localhost.localdomain:38397/solr/shard1 defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 120116 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 120129 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 120129 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 120131 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=82.2099609375, floorSegmentMB=0.3154296875, forceMergeDeletesPctAllowed=2.3903587609187427, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 120186 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@648fbc[collection1] main]
   [junit4]   2> 120187 WARN  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 120190 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 120193 INFO  (searcherExecutor-411-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@648fbc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 120193 INFO  (coreLoadExecutor-410-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600776569201098752
   [junit4]   2> 120196 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 120255 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFSThreadSafety
   [junit4]   2> 120256 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 120263 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@9f04f8[collection1] realtime]
   [junit4]   2> 120264 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 8
   [junit4]   2> 120265 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600776569276596224,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 120265 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1d77f52 commitCommandVersion:1600776569276596224
   [junit4]   2> 120289 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|FINALIZED]]} size 0
   [junit4]   2> 120289 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|FINALIZED]]} size 0
   [junit4]   2> 120294 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ddfce1[collection1] main]
   [junit4]   2> 120295 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 120299 INFO  (searcherExecutor-411-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ddfce1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 120300 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 35
   [junit4]   2> 120334 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0 (1600776569315393536)]} 0 32
   [junit4]   2> 120347 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1 (1600776569360482304)]} 0 1
   [junit4]   2> 120359 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2 (1600776569373065216)]} 0 1
   [junit4]   2> 120371 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3 (1600776569385648128)]} 0 1
   [junit4]   2> 120383 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4 (1600776569398231040)]} 0 1
   [junit4]   2> 120395 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[5 (1600776569410813952)]} 0 1
   [junit4]   2> 120407 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[6 (1600776569423396864)]} 0 1
   [junit4]   2> 120419 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[7 (1600776569437028352)]} 0 1
   [junit4]   2> 120421 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 120421 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1d77f52 commitCommandVersion:0
   [junit4]   2> 120449 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120450 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741828_1004 size 181
   [junit4]   2> 120460 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8 (1600776569448562688)]} 0 30
   [junit4]   2> 120500 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9 (1600776569492602880)]} 0 29
   [junit4]   2> 120503 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741830_1006{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|RBW]]} size 0
   [junit4]   2> 120505 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741830_1006 size 289
   [junit4]   2> 120512 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[10 (1600776569534545920)]} 0 1
   [junit4]   2> 120522 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|RBW]]} size 0
   [junit4]   2> 120523 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|RBW]]} size 0
   [junit4]   2> 120524 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[11 (1600776569547128832)]} 0 1
   [junit4]   2> 120541 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[12 (1600776569558663168)]} 0 6
   [junit4]   2> 120544 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120545 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120554 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[13 (1600776569578586112)]} 0 1
   [junit4]   2> 120556 INFO  (IPC Server handler 8 on 38397) [    ] BlockStateChange BLOCK* addToInvalidates: blk_1073741825_1001 127.0.0.1:44993 127.0.0.1:38387 
   [junit4]   2> 120566 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[14 (1600776569591169024)]} 0 1
   [junit4]   2> 120568 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1580a8c[collection1] realtime]
   [junit4]   2> 120577 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW]]} size 75
   [junit4]   2> 120578 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741827_1003 size 341
   [junit4]   2> 120579 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 120579 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 120579 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1d77f52 commitCommandVersion:0
   [junit4]   2> 120579 INFO  (Thread-379) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 2
   [junit4]   2> 120580 ERROR (Thread-379) [    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Exception writing document id 15 to the index; possible analysis error.
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246)
   [junit4]   2> 	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:67)
   [junit4]   2> 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)
   [junit4]   2> 	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:950)
   [junit4]   2> 	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1163)
   [junit4]   2> 	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:633)
   [junit4]   2> 	at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103)
   [junit4]   2> 	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:261)
   [junit4]   2> 	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:188)
   [junit4]   2> 	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
   [junit4]   2> 	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
   [junit4]   2> 	at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
   [junit4]   2> 	at org.apache.solr.util.TestHarness.update(TestHarness.java:284)
   [junit4]   2> 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:281)
   [junit4]   2> 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:251)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:863)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:842)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:836)
   [junit4]   2> 	at org.apache.solr.update.TestHdfsUpdateLog$2.run(TestHdfsUpdateLog.java:122)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.solr.update.UpdateLog.getCurrentLogSizeFromStream(UpdateLog.java:299)
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.getCurrentTLogSize(DirectUpdateHandler2.java:1007)
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291)
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:234)
   [junit4]   2> 	... 20 more
   [junit4]   2> 
   [junit4]   2> May 18, 2018 5:58:20 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-379,5,TGRP-TestHdfsUpdateLog]
   [junit4]   2> org.apache.solr.common.SolrException: Exception writing document id 15 to the index; possible analysis error.
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([6CDACEA730C11C07]:0)
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246)
   [junit4]   2> 	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:67)
   [junit4]   2> 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)
   [junit4]   2> 	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:950)
   [junit4]   2> 	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1163)
   [junit4]   2> 	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:633)
   [junit4]   2> 	at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103)
   [junit4]   2> 	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:261)
   [junit4]   2> 	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:188)
   [junit4]   2> 	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
   [junit4]   2> 	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
   [junit4]   2> 	at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
   [junit4]   2> 	at org.apache.solr.util.TestHarness.update(TestHarness.java:284)
   [junit4]   2> 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:281)
   [junit4]   2> 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:251)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:863)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:842)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:836)
   [junit4]   2> 	at org.apache.solr.update.TestHdfsUpdateLog$2.run(TestHdfsUpdateLog.java:122)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.solr.update.UpdateLog.getCurrentLogSizeFromStream(UpdateLog.java:299)
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.getCurrentTLogSize(DirectUpdateHandler2.java:1007)
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291)
   [junit4]   2> 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:234)
   [junit4]   2> 	... 20 more
   [junit4]   2> 
   [junit4]   2> 120596 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741833_1009{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|FINALIZED]]} size 0
   [junit4]   2> 120597 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741833_1009{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|FINALIZED], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120615 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW]]} size 0
   [junit4]   2> 120615 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|FINALIZED]]} size 0
   [junit4]   2> 120627 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741835_1011{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120627 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741835_1011 size 289
   [junit4]   2> 120638 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|RBW]]} size 0
   [junit4]   2> 120638 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|RBW]]} size 0
   [junit4]   2> 120649 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120650 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120661 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741838_1014{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-97ea20e4-c1b4-48dd-b190-3ad3089b9d17:NORMAL:127.0.0.1:44993|FINALIZED]]} size 0
   [junit4]   2> 120662 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741838_1014 size 289
   [junit4]   2> 120672 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2cb9bbff-b08a-4ea4-ac57-36f3cb2d7048:NORMAL:127.0.0.1:38387|RBW], ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|FINALIZED]]} size 0
   [junit4]   2> 120673 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|FINALIZED], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|FINALIZED]]} size 0
   [junit4]   2> 120681 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ee825[collection1] realtime]
   [junit4]   2> 120686 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38387 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|RBW]]} size 75
   [junit4]   2> 120686 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44993 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5e66c235-245f-49fc-96f6-5d16885fd6b5:NORMAL:127.0.0.1:44993|RBW], ReplicaUC[[DISK]DS-26f81c26-f8fa-404c-be8b-1fa438641e82:NORMAL:127.0.0.1:38387|RBW]]} size 75
   [junit4]   2> 120687 INFO  (commitScheduler-414-thread-1) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 122257 INFO  (org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@1cdda89) [    ] BlockStateChange BLOCK* BlockManager: ask 127.0.0.1:38387 to delete [blk_1073741825_1001]
   [junit4]   2> 125257 INFO  (org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@1cdda89) [    ] BlockStateChange BLOCK* BlockManager: ask 127.0.0.1:44993 to delete [blk_1073741825_1001]
   [junit4]   2> 125509 INFO  (TEST-TestHdfsUpdateLog.testFSThreadSafety-seed#[6CDACEA730C11C07]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFSThreadSafety
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestHdfsUpdateLog -Dtests.method=testFSThreadSafety -Dtests.seed=6CDACEA730C11C07 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-QA -Dtests.timezone=Africa/Kinshasa -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   5.32s J2 | TestHdfsUpdateLog.testFSThreadSafety <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1934, name=Thread-379, state=RUNNABLE, group=TGRP-TestHdfsUpdateLog]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6CDACEA730C11C07:9AF5695CFD6BB4F4]:0)
   [junit4]    > Caused by: org.apache.solr.common.SolrException: Exception writing document id 15 to the index; possible analysis error.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6CDACEA730C11C07]:0)
   [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246)
   [junit4]    > 	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:67)
   [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)
   [junit4]    > 	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:950)
   [junit4]    > 	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1163)
   [junit4]    > 	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:633)
   [junit4]    > 	at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103)
   [junit4]    > 	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:261)
   [junit4]    > 	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:188)
   [junit4]    > 	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
   [junit4]    > 	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
   [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]    > 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
   [junit4]    > 	at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
   [junit4]    > 	at org.apache.solr.util.TestHarness.update(TestHarness.java:284)
   [junit4]    > 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:281)
   [junit4]    > 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:251)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:863)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:842)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:836)
   [junit4]    > 	at org.apache.solr.update.TestHdfsUpdateLog$2.run(TestHdfsUpdateLog.java:122)
   [junit4]    > Caused by: java.lang.NullPointerException
   [junit4]    > 	at org.apache.solr.update.UpdateLog.getCurrentLogSizeFromStream(UpdateLog.java:299)
   [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.getCurrentTLogSize(DirectUpdateHandler2.java:1007)
   [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291)
   [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:234)
   [junit4]    > 	... 20 more
   [junit4]   2> 125512 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 125512 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2203553
   [junit4]   2> 125512 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 125512 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1c3d777: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1433354
   [junit4]   2> 125515 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 125515 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d31229: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@11f953a
   [junit4]   2> 125517 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 125517 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@141efb4: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@17862c8
   [junit4]   2> 125518 INFO  (coreCloseExecutor-416-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@90cecf
   [junit4]   2> 125518 INFO  (coreCloseExecutor-416-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=90cecf
   [junit4]   2> 125518 INFO  (coreCloseExecutor-416-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2b02d4: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@108bd78
   [junit4]   2> 125541 INFO  (coreCloseExecutor-416-thread-1) [    x:collection1] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:38397/solr_hdfs_home/collection1/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001/index
   [junit4]   2> 125541 INFO  (coreCloseExecutor-416-thread-1) [    x:collection1] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:38397/solr_hdfs_home/collection1/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001
   [junit4]   2> 125542 INFO  (coreCloseExecutor-416-thread-1) [    x:collection1] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:38397/solr_hdfs_home/collection1/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/init-core-data-001/snapshot_metadata
   [junit4]   2> 125551 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 125624 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 125725 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:38397) [    ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
   [junit4]   2> 125725 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:38397) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1938064384-88.99.242.108-1526619494205 (Datanode Uuid e3183cd3-8aaa-48d0-9c08-ba2216e08253) service to localhost.localdomain/127.0.0.1:38397
   [junit4]   2> 125730 WARN  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 125771 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 125871 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:38397) [    ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
   [junit4]   2> 125871 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.TestHdfsUpdateLog_6CDACEA730C11C07-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:38397) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1938064384-88.99.242.108-1526619494205 (Datanode Uuid 70a2a464-d9b9-4bea-860e-902e70855e2b) service to localhost.localdomain/127.0.0.1:38397
   [junit4]   2> 125912 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
   [junit4]   2> 126018 INFO  (SUITE-TestHdfsUpdateLog-seed#[6CDACEA730C11C07]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> May 18, 2018 4:58:26 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 66 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=ar-QA, timezone=Africa/Kinshasa
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=6,free=45617384,total=112533504
   [junit4]   2> NOTE: All tests run in this JVM: [RestartWhileUpdatingTest, TestCoreAdminApis, TestValueSourceCache, MetricTriggerIntegrationTest, TestQueryTypes, ClusterStateTest, DistributedFacetPivotLongTailTest, TestSchemaManager, TestNumericTerms32, NumericFieldsTest, AssignTest, TestNonDefinedSimilarityFactory, SimpleCollectionCreateDeleteTest, TestTolerantSearch, SolrIndexMetricsTest, LIRRollingUpdatesTest, TestTrieFacet, TestBlendedInfixSuggestions, DateMathParserTest, TestHdfsUpdateLog]
   [junit4] Completed [42/805 (1!)] on J2 in 22.44s, 1 test, 1 error <<< FAILURES!

[...truncated 48963 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1924/consoleText

[repro] Revision: 96f6c65e43445bbb0b77604c8c6550ca654b5de8

[repro] Ant options: "-Dargs=-server -XX:+UseConcMarkSweepGC"
[repro] Repro line:  ant test  -Dtestcase=TestHdfsUpdateLog -Dtests.method=testFSThreadSafety -Dtests.seed=6CDACEA730C11C07 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-QA -Dtests.timezone=Africa/Kinshasa -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestHdfsUpdateLog
[repro] ant compile-test

[...truncated 3316 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestHdfsUpdateLog" -Dtests.showOutput=onerror "-Dargs=-server -XX:+UseConcMarkSweepGC" -Dtests.seed=6CDACEA730C11C07 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-QA -Dtests.timezone=Africa/Kinshasa -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[...truncated 71 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.update.TestHdfsUpdateLog
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1927 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1927/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseG1GC

4 tests failed.
FAILED:  org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate

Error Message:
Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)

Stack Trace:
java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate

Error Message:
Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)

Stack Trace:
java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate

Error Message:
Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)

Stack Trace:
java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate

Error Message:
Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)

Stack Trace:
java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 21697 lines...]
   [junit4] Suite: org.apache.solr.handler.extraction.TestExtractionDateUtil
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExtractionDateUtil -Dtests.method=testParseDate -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.06s J1 | TestExtractionDateUtil.testParseDate <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, maxDocsPerChunk=2, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, blockSize=1)), sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=America/Metlakatla
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=34495920,total=67108864
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtractionDateUtil]
   [junit4] Completed [1/4 (1!)] on J1 in 0.64s, 2 tests, 1 failure <<< FAILURES!

[...truncated 39837 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1927/consoleText

[repro] Revision: 443bd2ac526a40079e9028a5e7d8ad2f24ca6a4b

[repro] Ant options: "-Dargs=-server -XX:+UseG1GC"
[repro] Repro line:  ant test  -Dtestcase=TestExtractionDateUtil -Dtests.method=testParseDate -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/contrib/extraction
[repro]       TestExtractionDateUtil
[repro] ant compile-test

[...truncated 2578 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestExtractionDateUtil" -Dtests.showOutput=onerror "-Dargs=-server -XX:+UseG1GC" -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[...truncated 32 lines...]
   [junit4] Suite: org.apache.solr.handler.extraction.TestExtractionDateUtil
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExtractionDateUtil -Dtests.method=testParseDate -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.10s J1 | TestExtractionDateUtil.testParseDate <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.01s J1 | TestExtractionDateUtil.testISO8601
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, maxDocsPerChunk=2, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, blockSize=1)), sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=America/Metlakatla
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=34287768,total=67108864
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtractionDateUtil]
   [junit4] Completed [1/5 (1!)] on J1 in 0.92s, 2 tests, 1 failure <<< FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.handler.extraction.TestExtractionDateUtil
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExtractionDateUtil -Dtests.method=testParseDate -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.08s J2 | TestExtractionDateUtil.testParseDate <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.01s J2 | TestExtractionDateUtil.testISO8601
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, maxDocsPerChunk=2, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, blockSize=1)), sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=America/Metlakatla
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=35427992,total=67108864
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtractionDateUtil]
   [junit4] Completed [2/5 (2!)] on J2 in 0.91s, 2 tests, 1 failure <<< FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.handler.extraction.TestExtractionDateUtil
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExtractionDateUtil -Dtests.method=testParseDate -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.11s J0 | TestExtractionDateUtil.testParseDate <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.01s J0 | TestExtractionDateUtil.testISO8601
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, maxDocsPerChunk=2, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, blockSize=1)), sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=America/Metlakatla
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=35638592,total=67108864
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtractionDateUtil]
   [junit4] Completed [3/5 (3!)] on J0 in 0.89s, 2 tests, 1 failure <<< FAILURES!

[...truncated 2 lines...]
   [junit4] Suite: org.apache.solr.handler.extraction.TestExtractionDateUtil
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExtractionDateUtil -Dtests.method=testParseDate -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.02s J1 | TestExtractionDateUtil.testParseDate <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.00s J1 | TestExtractionDateUtil.testISO8601
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, maxDocsPerChunk=2, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, blockSize=1)), sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=America/Metlakatla
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=23222616,total=67108864
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtractionDateUtil, TestExtractionDateUtil]
   [junit4] Completed [4/5 (4!)] on J1 in 0.04s, 2 tests, 1 failure <<< FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.handler.extraction.TestExtractionDateUtil
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExtractionDateUtil -Dtests.method=testParseDate -Dtests.seed=5A1630E22E395855 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr -Dtests.timezone=America/Metlakatla -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.01s J0 | TestExtractionDateUtil.testParseDate <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Incorrect parsed timestamp: 1226583351000 != 1226579751000 (Thu Nov 13 04:35:51 AKST 2008)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5A1630E22E395855:100F48D755902FE0]:0)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.assertParsedDate(TestExtractionDateUtil.java:59)
   [junit4]    > 	at org.apache.solr.handler.extraction.TestExtractionDateUtil.testParseDate(TestExtractionDateUtil.java:54)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.00s J0 | TestExtractionDateUtil.testISO8601
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, maxDocsPerChunk=2, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=1, blockSize=1)), sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=America/Metlakatla
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=25065480,total=67108864
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtractionDateUtil, TestExtractionDateUtil]
   [junit4] Completed [5/5 (5!)] on J0 in 0.04s, 2 tests, 1 failure <<< FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1568: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1092: There were test failures: 5 suites, 10 tests, 5 failures [seed: 5A1630E22E395855]

Total time: 3 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.handler.extraction.TestExtractionDateUtil
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=443bd2ac526a40079e9028a5e7d8ad2f24ca6a4b, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1926
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_162) - Build # 1926 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1926/
Java: 64bit/jdk1.8.0_162 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode

Error Message:
unexpected DELETENODE status: {responseHeader={status=0,QTime=1},status={state=notfound,msg=Did not find [search_rate_trigger3/6d2d0ace2693bTafqt3w0mwy6b89uek476k3gt/0] in any tasks queue}}

Stack Trace:
java.lang.AssertionError: unexpected DELETENODE status: {responseHeader={status=0,QTime=1},status={state=notfound,msg=Did not find [search_rate_trigger3/6d2d0ace2693bTafqt3w0mwy6b89uek476k3gt/0] in any tasks queue}}
	at __randomizedtesting.SeedInfo.seed([C544D475E009EFC9:E7D61AF7D7C360B4]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.lambda$testDeleteNode$6(SearchRateTriggerIntegrationTest.java:668)
	at java.util.ArrayList.forEach(ArrayList.java:1257)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode(SearchRateTriggerIntegrationTest.java:660)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14717 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/init-core-data-001
   [junit4]   2> 1662887 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[C544D475E009EFC9]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001
   [junit4]   2> 1662888 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[C544D475E009EFC9]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1662890 INFO  (Thread-4485) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1662890 INFO  (Thread-4485) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1662892 ERROR (Thread-4485) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1662990 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[C544D475E009EFC9]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:37421
   [junit4]   2> 1662993 INFO  (zkConnectionManagerCallback-7339-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1662998 INFO  (jetty-launcher-7336-thread-2) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_162-b12
   [junit4]   2> 1662998 INFO  (jetty-launcher-7336-thread-1) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_162-b12
   [junit4]   2> 1662999 INFO  (jetty-launcher-7336-thread-5) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_162-b12
   [junit4]   2> 1662999 INFO  (jetty-launcher-7336-thread-3) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_162-b12
   [junit4]   2> 1662999 INFO  (jetty-launcher-7336-thread-4) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_162-b12
   [junit4]   2> 1663013 INFO  (jetty-launcher-7336-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1663013 INFO  (jetty-launcher-7336-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1663013 INFO  (jetty-launcher-7336-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1663013 INFO  (jetty-launcher-7336-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1663013 INFO  (jetty-launcher-7336-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1663013 INFO  (jetty-launcher-7336-thread-3) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1663013 INFO  (jetty-launcher-7336-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37140782{/solr,null,AVAILABLE}
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-5) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b7aaed1{/solr,null,AVAILABLE}
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7ccdcac0{SSL,[ssl, http/1.1]}{127.0.0.1:43311}
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.e.j.s.Server Started @1663040ms
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@69570708{/solr,null,AVAILABLE}
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43311}
   [junit4]   2> 1663014 ERROR (jetty-launcher-7336-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@666494a9{SSL,[ssl, http/1.1]}{127.0.0.1:41899}
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-2) [    ] o.e.j.s.Server Started @1663040ms
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41899}
   [junit4]   2> 1663014 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T14:41:57.491Z
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6cdd0888{SSL,[ssl, http/1.1]}{127.0.0.1:42035}
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.e.j.s.Server Started @1663040ms
   [junit4]   2> 1663015 ERROR (jetty-launcher-7336-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42035}
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 1663015 ERROR (jetty-launcher-7336-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T14:41:57.492Z
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7b1b6d57{/solr,null,AVAILABLE}
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T14:41:57.492Z
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1663015 INFO  (jetty-launcher-7336-thread-4) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1663015 INFO  (zkConnectionManagerCallback-7341-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@63ad6452{/solr,null,AVAILABLE}
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@24732685{SSL,[ssl, http/1.1]}{127.0.0.1:41699}
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.e.j.s.Server Started @1663041ms
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41699}
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1663016 ERROR (jetty-launcher-7336-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@9ea708e{SSL,[ssl, http/1.1]}{127.0.0.1:33277}
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.e.j.s.Server Started @1663042ms
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33277}
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T14:41:57.493Z
   [junit4]   2> 1663016 ERROR (jetty-launcher-7336-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1663016 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T14:41:57.493Z
   [junit4]   2> 1663016 INFO  (zkConnectionManagerCallback-7343-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663017 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1663017 INFO  (zkConnectionManagerCallback-7345-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663017 INFO  (zkConnectionManagerCallback-7349-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663017 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1663017 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1663017 INFO  (zkConnectionManagerCallback-7347-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663017 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1663023 INFO  (jetty-launcher-7336-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37421/solr
   [junit4]   2> 1663023 INFO  (jetty-launcher-7336-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37421/solr
   [junit4]   2> 1663024 INFO  (jetty-launcher-7336-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37421/solr
   [junit4]   2> 1663024 INFO  (jetty-launcher-7336-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37421/solr
   [junit4]   2> 1663024 INFO  (jetty-launcher-7336-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37421/solr
   [junit4]   2> 1663024 INFO  (zkConnectionManagerCallback-7366-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663024 INFO  (zkConnectionManagerCallback-7360-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663024 INFO  (zkConnectionManagerCallback-7363-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663025 INFO  (zkConnectionManagerCallback-7367-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663025 INFO  (zkConnectionManagerCallback-7369-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663025 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007278a9630006, likely client has closed socket
   [junit4]   2> 1663025 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007278a9630009, likely client has closed socket
   [junit4]   2> 1663025 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007278a963000a, likely client has closed socket
   [junit4]   2> 1663025 INFO  (zkConnectionManagerCallback-7375-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663026 INFO  (zkConnectionManagerCallback-7371-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663026 INFO  (zkConnectionManagerCallback-7373-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663026 INFO  (zkConnectionManagerCallback-7379-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663026 INFO  (zkConnectionManagerCallback-7377-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41899_solr
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41699_solr
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43311_solr
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33277_solr
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42035_solr
   [junit4]   2> 1663061 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.Overseer Overseer (id=72183456601407500-127.0.0.1:41899_solr-n_0000000000) starting
   [junit4]   2> 1663063 INFO  (zkCallback-7374-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1663063 INFO  (zkCallback-7372-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1663063 INFO  (zkCallback-7370-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1663063 INFO  (zkCallback-7378-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1663063 INFO  (zkCallback-7376-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1663074 INFO  (zkConnectionManagerCallback-7394-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663075 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1663075 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37421/solr ready
   [junit4]   2> 1663083 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1663083 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1663083 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 1663083 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41899_solr
   [junit4]   2> 1663084 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 1663084 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1663084 INFO  (zkCallback-7374-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1663087 INFO  (zkCallback-7370-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1663087 INFO  (zkCallback-7376-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1663087 INFO  (zkCallback-7378-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1663087 INFO  (zkCallback-7372-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1663087 INFO  (zkCallback-7393-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1663088 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:43311_solr, 127.0.0.1:41699_solr, 127.0.0.1:41899_solr, 127.0.0.1:33277_solr, 127.0.0.1:42035_solr]
   [junit4]   2> 1663095 DEBUG (ScheduledTrigger-7394-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 1663098 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1663099 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1663135 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42035.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663143 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43311.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663143 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42035.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663148 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42035.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663150 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node1/.
   [junit4]   2> 1663153 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43311.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663154 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43311.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663154 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node3/.
   [junit4]   2> 1663160 INFO  (zkConnectionManagerCallback-7399-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663160 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1663161 INFO  (jetty-launcher-7336-thread-1) [n:127.0.0.1:42035_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37421/solr ready
   [junit4]   2> 1663172 INFO  (zkConnectionManagerCallback-7404-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663172 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1663173 INFO  (jetty-launcher-7336-thread-3) [n:127.0.0.1:43311_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37421/solr ready
   [junit4]   2> 1663181 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41899.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663187 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41899.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663188 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41899.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663188 INFO  (jetty-launcher-7336-thread-2) [n:127.0.0.1:41899_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node2/.
   [junit4]   2> 1663199 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33277.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663204 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33277.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663204 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33277.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663205 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node4/.
   [junit4]   2> 1663207 INFO  (zkConnectionManagerCallback-7409-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663207 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1663208 INFO  (jetty-launcher-7336-thread-4) [n:127.0.0.1:33277_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37421/solr ready
   [junit4]   2> 1663257 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41699.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663264 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41699.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663264 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41699.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1663265 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node5/.
   [junit4]   2> 1663268 INFO  (zkConnectionManagerCallback-7414-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663268 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1663269 INFO  (jetty-launcher-7336-thread-5) [n:127.0.0.1:41699_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37421/solr ready
   [junit4]   2> 1663301 INFO  (zkConnectionManagerCallback-7416-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663303 INFO  (zkConnectionManagerCallback-7421-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1663304 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[C544D475E009EFC9]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1663305 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[C544D475E009EFC9]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37421/solr ready
   [junit4]   2> 1663332 INFO  (qtp156783874-21743) [n:127.0.0.1:33277_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1663345 INFO  (qtp636186364-21721) [n:127.0.0.1:42035_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1663355 INFO  (qtp960986965-21726) [n:127.0.0.1:43311_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1663359 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1663369 INFO  (qtp1541673257-21739) [n:127.0.0.1:41899_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1663369 DEBUG (qtp1022370967-21734) [n:127.0.0.1:41699_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1663370 INFO  (qtp1022370967-21734) [n:127.0.0.1:41699_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=51
   [junit4]   2> 1663370 DEBUG (zkCallback-7393-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 1663371 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 1663391 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1663394 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 1663478 INFO  (TEST-SearchRateTriggerIntegrationTest.testBelowSearchRate-seed#[C544D475E009EFC9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1663479 INFO  (TEST-SearchRateTriggerIntegrationTest.testBelowSearchRate-seed#[C544D475E009EFC9]) [    ] o.a.s.c.a.SearchRateTriggerIntegrationTest /autoscaling.json reset, new znode version 3
   [junit4]   2> 1663479 DEBUG (zkCallback-7393-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 1663479 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 1663481 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1663481 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1663481 DEBUG (OverseerAutoScalingTriggerThread-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 1668482 INFO  (qtp156783874-21743) [n:127.0.0.1:33277_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=belowRate_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1668483 INFO  (OverseerThreadFactory-7396-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection belowRate_collection
   [junit4]   2> 1668588 INFO  (OverseerStateUpdate-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"belowRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"belowRate_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41899/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1668588 INFO  (OverseerStateUpdate-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"belowRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"belowRate_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33277/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1668796 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr    x:belowRate_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=belowRate_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1668796 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr    x:belowRate_collection_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=belowRate_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1668797 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr    x:belowRate_collection_shard1_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1669805 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1669805 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1669810 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.s.IndexSchema [belowRate_collection_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1669810 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.s.IndexSchema [belowRate_collection_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 1669811 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1669811 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1669812 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'belowRate_collection_shard1_replica_n1' using configuration from collection belowRate_collection, trusted=true
   [junit4]   2> 1669812 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'belowRate_collection_shard1_replica_n2' using configuration from collection belowRate_collection, trusted=true
   [junit4]   2> 1669812 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33277.solr.core.belowRate_collection.shard1.replica_n2' (registry 'solr.core.belowRate_collection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1669812 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41899.solr.core.belowRate_collection.shard1.replica_n1' (registry 'solr.core.belowRate_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1669812 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1669812 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1669812 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.SolrCore [[belowRate_collection_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node4/belowRate_collection_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node4/./belowRate_collection_shard1_replica_n2/data/]
   [junit4]   2> 1669812 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.SolrCore [[belowRate_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node2/belowRate_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node2/./belowRate_collection_shard1_replica_n1/data/]
   [junit4]   2> 1669842 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1669842 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1669842 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1669842 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1669843 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1669843 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1669843 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1669843 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1669844 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@f2ab2a8[belowRate_collection_shard1_replica_n2] main]
   [junit4]   2> 1669844 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2d11cf86[belowRate_collection_shard1_replica_n1] main]
   [junit4]   2> 1669844 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1669844 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1669845 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1669845 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1669845 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1669845 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1669846 INFO  (searcherExecutor-7408-thread-1-processing-n:127.0.0.1:33277_solr x:belowRate_collection_shard1_replica_n2 c:belowRate_collection s:shard1 r:core_node4) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.SolrCore [belowRate_collection_shard1_replica_n2] Registered new searcher Searcher@f2ab2a8[belowRate_collection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1669846 INFO  (searcherExecutor-7407-thread-1-processing-n:127.0.0.1:41899_solr x:belowRate_collection_shard1_replica_n1 c:belowRate_collection s:shard1 r:core_node3) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.SolrCore [belowRate_collection_shard1_replica_n1] Registered new searcher Searcher@2d11cf86[belowRate_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1669846 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600813294496514048
   [junit4]   2> 1669846 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600813294496514048
   [junit4]   2> 1669848 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/belowRate_collection/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 1669849 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
   [junit4]   2> 1669849 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/belowRate_collection/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1669850 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1669850 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1669850 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41899/solr/belowRate_collection_shard1_replica_n1/
   [junit4]   2> 1669850 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=belowRate_collection_shard1_replica_n1 url=https://127.0.0.1:41899/solr START replicas=[https://127.0.0.1:33277/solr/belowRate_collection_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 1669852 INFO  (qtp156783874-21864) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.c.S.Request [belowRate_collection_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1670150 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=belowRate_collection_shard1_replica_n1 url=https://127.0.0.1:41899/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1670150 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1670151 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1670151 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1670153 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41899/solr/belowRate_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1670254 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1670255 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=belowRate_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1458
   [junit4]   2> 1670355 INFO  (zkCallback-7374-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1670876 INFO  (qtp156783874-21719) [n:127.0.0.1:33277_solr c:belowRate_collection s:shard1 r:core_node4 x:belowRate_collection_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=belowRate_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2079
   [junit4]   2> 1670878 INFO  (qtp156783874-21743) [n:127.0.0.1:33277_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1670954 INFO  (zkCallback-7378-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1670954 INFO  (zkCallback-7374-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1671879 INFO  (qtp156783874-21743) [n:127.0.0.1:33277_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=belowRate_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3396
   [junit4]   2> 1671879 INFO  (qtp156783874-21748) [n:127.0.0.1:33277_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=belowRate_collection&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1671881 INFO  (OverseerCollectionConfigSetProcessor-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1671881 INFO  (OverseerThreadFactory-7396-thread-2) [ c:belowRate_collection s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:43311_solr for creating new replica
   [junit4]   2> 1671882 INFO  (OverseerStateUpdate-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"belowRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"belowRate_collection_shard1_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:43311/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43311_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1671983 INFO  (zkCallback-7378-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1671983 INFO  (zkCallback-7374-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672087 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr    x:belowRate_collection_shard1_replica_n5] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&name=belowRate_collection_shard1_replica_n5&action=CREATE&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1672088 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr    x:belowRate_collection_shard1_replica_n5] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1672094 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1672107 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.s.IndexSchema [belowRate_collection_shard1_replica_n5] Schema name=minimal
   [junit4]   2> 1672108 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1672108 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.CoreContainer Creating SolrCore 'belowRate_collection_shard1_replica_n5' using configuration from collection belowRate_collection, trusted=true
   [junit4]   2> 1672108 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43311.solr.core.belowRate_collection.shard1.replica_n5' (registry 'solr.core.belowRate_collection.shard1.replica_n5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1672108 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1672108 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.SolrCore [[belowRate_collection_shard1_replica_n5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node3/belowRate_collection_shard1_replica_n5], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node3/./belowRate_collection_shard1_replica_n5/data/]
   [junit4]   2> 1672136 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1672136 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1672137 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1672137 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1672137 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@4ebef79d[belowRate_collection_shard1_replica_n5] main]
   [junit4]   2> 1672138 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1672138 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1672138 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1672139 INFO  (searcherExecutor-7417-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.SolrCore [belowRate_collection_shard1_replica_n5] Registered new searcher Searcher@4ebef79d[belowRate_collection_shard1_replica_n5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1672139 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600813296900898816
   [junit4]   2> 1672141 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.ZkShardTerms Successful update of terms at /collections/belowRate_collection/terms/shard1 to Terms{values={core_node6=0, core_node3=0, core_node4=0}, version=2}
   [junit4]   2> 1672142 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.ZkController Core needs to recover:belowRate_collection_shard1_replica_n5
   [junit4]   2> 1672142 INFO  (updateExecutor-7350-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 1672142 INFO  (recoveryExecutor-7356-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 1672142 INFO  (recoveryExecutor-7356-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 1672144 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.S.Request [belowRate_collection_shard1_replica_n1]  webapp=/solr path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1672145 INFO  (qtp1541673257-21740) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.S.Request [belowRate_collection_shard1_replica_n1]  webapp=/solr path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1672145 INFO  (recoveryExecutor-7356-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[belowRate_collection_shard1_replica_n5]
   [junit4]   2> 1672145 INFO  (recoveryExecutor-7356-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 1672145 INFO  (recoveryExecutor-7356-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Publishing state of core [belowRate_collection_shard1_replica_n5] as recovering, leader is [https://127.0.0.1:41899/solr/belowRate_collection_shard1_replica_n1/] and I am [https://127.0.0.1:43311/solr/belowRate_collection_shard1_replica_n5/]
   [junit4]   2> 1672145 INFO  (recoveryExecutor-7356-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.ZkShardTerms Successful update of terms at /collections/belowRate_collection/terms/shard1 to Terms{values={core_node6=0, core_node6_recovering=0, core_node3=0, core_node4=0}, version=3}
   [junit4]   2> 1672146 INFO  (recoveryExecutor-7356-thread-1-processing-n:127.0.0.1:43311_solr x:belowRate_collection_shard1_replica_n5 c:belowRate_collection s:shard1 r:core_node6) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:41899/solr]; [WaitForState: action=PREPRECOVERY&core=belowRate_collection_shard1_replica_n1&nodeName=127.0.0.1:43311_solr&coreNodeName=core_node6&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 1672147 INFO  (qtp1541673257-21711) [n:127.0.0.1:41899_solr    x:belowRate_collection_shard1_replica_n1] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node6, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 1672147 INFO  (qtp1541673257-21711) [n:127.0.0.1:41899_solr    x:belowRate_collection_shard1_replica_n1] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=belowRate_collection, shard=shard1, thisCore=belowRate_collection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:43311_solr, coreNodeName=core_node6, onlyIfActiveCheckResult=false, nodeProps: core_node6:{"core":"belowRate_collection_shard1_replica_n5","base_url":"https://127.0.0.1:43311/solr","state":"down","node_name":"127.0.0.1:43311_solr","type":"NRT"}
   [junit4]   2> 1672189 INFO  (qtp960986965-21729) [n:127.0.0.1:43311_solr c:belowRate_collection s:shard1 r:core_node6 x:belowRate_collection_shard1_replica_n5] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&name=belowRate_collection_shard1_replica_n5&action=CREATE&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=102
   [junit4]   2> 1672191 INFO  (qtp156783874-21748) [n:127.0.0.1:33277_solr c:belowRate_collection   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=belowRate_collection&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=311
   [junit4]   2> 1672191 INFO  (qtp156783874-21743) [n:127.0.0.1:33277_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=belowRate_collection&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1672192 INFO  (OverseerCollectionConfigSetProcessor-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1672193 INFO  (OverseerThreadFactory-7396-thread-3) [ c:belowRate_collection s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:41699_solr for creating new replica
   [junit4]   2> 1672193 INFO  (OverseerStateUpdate-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"belowRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"belowRate_collection_shard1_replica_t7",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41699/solr",
   [junit4]   2>   "node_name":"127.0.0.1:41699_solr",
   [junit4]   2>   "type":"TLOG"} 
   [junit4]   2> 1672294 INFO  (zkCallback-7374-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672294 INFO  (zkCallback-7378-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672294 INFO  (zkCallback-7370-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672295 INFO  (zkCallback-7370-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672295 INFO  (zkCallback-7370-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672396 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr    x:belowRate_collection_shard1_replica_t7] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&name=belowRate_collection_shard1_replica_t7&action=CREATE&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1672396 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr    x:belowRate_collection_shard1_replica_t7] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1672403 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1672407 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.s.IndexSchema [belowRate_collection_shard1_replica_t7] Schema name=minimal
   [junit4]   2> 1672409 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1672409 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.CoreContainer Creating SolrCore 'belowRate_collection_shard1_replica_t7' using configuration from collection belowRate_collection, trusted=true
   [junit4]   2> 1672409 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41699.solr.core.belowRate_collection.shard1.replica_t7' (registry 'solr.core.belowRate_collection.shard1.replica_t7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e469aa4
   [junit4]   2> 1672409 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1672409 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.SolrCore [[belowRate_collection_shard1_replica_t7] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node5/belowRate_collection_shard1_replica_t7], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_C544D475E009EFC9-001/tempDir-001/node5/./belowRate_collection_shard1_replica_t7/data/]
   [junit4]   2> 1672444 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1672444 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1672444 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1672444 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1672445 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.s.SolrIndexSearcher Opening [Searcher@52b6ebba[belowRate_collection_shard1_replica_t7] main]
   [junit4]   2> 1672446 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1672446 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1672446 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1672447 INFO  (searcherExecutor-7422-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.SolrCore [belowRate_collection_shard1_replica_t7] Registered new searcher Searcher@52b6ebba[belowRate_collection_shard1_replica_t7] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1672447 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600813297223860224
   [junit4]   2> 1672450 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.ZkShardTerms Successful update of terms at /collections/belowRate_collection/terms/shard1 to Terms{values={core_node6=0, core_node8=0, core_node6_recovering=0, core_node3=0, core_node4=0}, version=4}
   [junit4]   2> 1672450 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.ZkController Core needs to recover:belowRate_collection_shard1_replica_t7
   [junit4]   2> 1672452 INFO  (updateExecutor-7353-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 1672453 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 1672453 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 1672453 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.ZkController belowRate_collection_shard1_replica_t7 stopping background replication from leader
   [junit4]   2> 1672453 INFO  (qtp1022370967-21737) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&name=belowRate_collection_shard1_replica_t7&action=CREATE&collection=belowRate_collection&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=57
   [junit4]   2> 1672454 INFO  (qtp156783874-21743) [n:127.0.0.1:33277_solr c:belowRate_collection   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=belowRate_collection&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=262
   [junit4]   2> 1672454 INFO  (qtp156783874-21748) [n:127.0.0.1:33277_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=belowRate_collection&shard=shard1&type=PULL&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1672455 INFO  (qtp1541673257-21736) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.S.Request [belowRate_collection_shard1_replica_n1]  webapp=/solr path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1672455 INFO  (qtp1541673257-21736) [n:127.0.0.1:41899_solr c:belowRate_collection s:shard1 r:core_node3 x:belowRate_collection_shard1_replica_n1] o.a.s.c.S.Request [belowRate_collection_shard1_replica_n1]  webapp=/solr path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1672455 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[belowRate_collection_shard1_replica_t7]
   [junit4]   2> 1672455 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 1672455 INFO  (OverseerCollectionConfigSetProcessor-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1672455 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Publishing state of core [belowRate_collection_shard1_replica_t7] as recovering, leader is [https://127.0.0.1:41899/solr/belowRate_collection_shard1_replica_n1/] and I am [https://127.0.0.1:41699/solr/belowRate_collection_shard1_replica_t7/]
   [junit4]   2> 1672456 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.ZkShardTerms Successful update of terms at /collections/belowRate_collection/terms/shard1 to Terms{values={core_node6=0, core_node8_recovering=0, core_node8=0, core_node6_recovering=0, core_node3=0, core_node4=0}, version=5}
   [junit4]   2> 1672456 INFO  (OverseerThreadFactory-7396-thread-4) [ c:belowRate_collection s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:42035_solr for creating new replica
   [junit4]   2> 1672456 INFO  (recoveryExecutor-7358-thread-1-processing-n:127.0.0.1:41699_solr x:belowRate_collection_shard1_replica_t7 c:belowRate_collection s:shard1 r:core_node8) [n:127.0.0.1:41699_solr c:belowRate_collection s:shard1 r:core_node8 x:belowRate_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:41899/solr]; [WaitForState: action=PREPRECOVERY&core=belowRate_collection_shard1_replica_n1&nodeName=127.0.0.1:41699_solr&coreNodeName=core_node8&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 1672457 INFO  (OverseerStateUpdate-72183456601407500-127.0.0.1:41899_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"belowRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"belowRate_collection_shard1_replica_p9",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42035/solr",
   [junit4]   2>   "node_name":"127.0.0.1:42035_solr",
   [junit4]   2>   "type":"PULL"} 
   [junit4]   2> 1672458 INFO  (qtp1541673257-21875) [n:127.0.0.1:41899_solr    x:belowRate_collection_shard1_replica_n1] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node8, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 1672458 INFO  (qtp1541673257-21875) [n:127.0.0.1:41899_solr    x:belowRate_collection_shard1_replica_n1] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=belowRate_collection, shard=shard1, thisCore=belowRate_collection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:41699_solr, coreNodeName=core_node8, onlyIfActiveCheckResult=false, nodeProps: core_node8:{"core":"belowRate_collection_shard1_replica_t7","base_url":"https://127.0.0.1:41699/solr","state":"down","node_name":"127.0.0.1:41699_solr","type":"TLOG"}
   [junit4]   2> 1672558 INFO  (zkCallback-7374-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672558 INFO  (zkCallback-7378-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672558 INFO  (zkCallback-7370-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672558 INFO  (zkCallback-7370-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672558 INFO  (zkCallback-7370-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672558 INFO  (zkCallback-7376-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672558 INFO  (zkCallback-7376-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/belowRate_collection/state.json] for collection [belowRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1672558 I

[...truncated too long message...]

ildfile: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/build.xml

-clover.disable:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 18ms :: artifacts dl 1ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: C544D475E009EFC9
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says ¡Hola! Master seed: C544D475E009EFC9
   [junit4] Executing 5 suites with 3 JVMs.
   [junit4] 
   [junit4] Started J2 PID(17679@serv1.sd-datasolutions.de).
   [junit4] Started J0 PID(17680@serv1.sd-datasolutions.de).
   [junit4] Started J1 PID(17678@serv1.sd-datasolutions.de).
   [junit4] HEARTBEAT J2 PID(17679@serv1.sd-datasolutions.de): 2018-05-18T15:04:04, stalled for 63.2s at: SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] HEARTBEAT J0 PID(17680@serv1.sd-datasolutions.de): 2018-05-18T15:04:04, stalled for 61.7s at: SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] HEARTBEAT J1 PID(17678@serv1.sd-datasolutions.de): 2018-05-18T15:04:04, stalled for 62.0s at: SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] HEARTBEAT J0 PID(17680@serv1.sd-datasolutions.de): 2018-05-18T15:06:04, stalled for 66.9s at: SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] HEARTBEAT J1 PID(17678@serv1.sd-datasolutions.de): 2018-05-18T15:06:04, stalled for 66.9s at: SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] HEARTBEAT J2 PID(17679@serv1.sd-datasolutions.de): 2018-05-18T15:06:04, stalled for 68.4s at: SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4] OK      77.5s J2 | SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] OK      37.2s J2 | SearchRateTriggerIntegrationTest.testAboveSearchRate
   [junit4] OK      71.9s J2 | SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] Completed [1/5] on J2 in 196.17s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4] OK      77.6s J1 | SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] OK      37.3s J1 | SearchRateTriggerIntegrationTest.testAboveSearchRate
   [junit4] OK      71.9s J1 | SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] Completed [2/5] on J1 in 197.80s, 3 tests
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4] OK      77.7s J0 | SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] OK      37.2s J0 | SearchRateTriggerIntegrationTest.testAboveSearchRate
   [junit4] OK      71.9s J0 | SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] Completed [3/5] on J0 in 200.06s, 3 tests
   [junit4] 
   [junit4] HEARTBEAT J1 PID(17678@serv1.sd-datasolutions.de): 2018-05-18T15:07:16, stalled for 64.1s at: SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] HEARTBEAT J2 PID(17679@serv1.sd-datasolutions.de): 2018-05-18T15:07:16, stalled for 66.0s at: SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] HEARTBEAT J2 PID(17679@serv1.sd-datasolutions.de): 2018-05-18T15:09:04, stalled for 60.9s at: SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] HEARTBEAT J1 PID(17678@serv1.sd-datasolutions.de): 2018-05-18T15:09:16, stalled for 71.0s at: SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4] OK      76.2s J2 | SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] OK      36.8s J2 | SearchRateTriggerIntegrationTest.testAboveSearchRate
   [junit4] OK      72.0s J2 | SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] Completed [4/5] on J2 in 188.24s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4] OK      76.3s J1 | SearchRateTriggerIntegrationTest.testBelowSearchRate
   [junit4] OK      36.7s J1 | SearchRateTriggerIntegrationTest.testAboveSearchRate
   [junit4] OK      71.7s J1 | SearchRateTriggerIntegrationTest.testDeleteNode
   [junit4] Completed [5/5] on J1 in 187.71s, 3 tests
   [junit4] 
   [junit4] JVM J0:     0.41 ..   201.33 =   200.92s
   [junit4] JVM J1:     0.64 ..   387.21 =   386.56s
   [junit4] JVM J2:     0.41 ..   386.03 =   385.62s
   [junit4] Execution time total: 6 minutes 27 seconds
   [junit4] Tests summary: 5 suites, 15 tests
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 192.13s | org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
[junit4:tophints] 123.86s | org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4:tophints] 116.79s | org.apache.solr.update.SoftAutoCommitTest
[junit4:tophints] 110.79s | org.apache.solr.cloud.ZkFailoverTest
[junit4:tophints]  90.52s | org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 6 minutes 29 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath$34.hasMatch(FilePath.java:2667)
	at hudson.FilePath$34.invoke(FilePath.java:2546)
	at hudson.FilePath$34.invoke(FilePath.java:2536)
	at hudson.FilePath.act(FilePath.java:1036)
	at hudson.FilePath.act(FilePath.java:1014)
	at hudson.FilePath.validateAntFileMask(FilePath.java:2536)
	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
	at hudson.model.Run.execute(Run.java:1819)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=443bd2ac526a40079e9028a5e7d8ad2f24ca6a4b, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1925
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1925 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1925/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([95DBDD57FD408A63:F610EBD5648FF94E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger(SearchRateTriggerTest.java:133)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRealTimeGet.testStressGetRealtime

Error Message:
Captured an uncaught exception in thread: Thread[id=18363, name=WRITER9, state=RUNNABLE, group=TGRP-TestRealTimeGet]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18363, name=WRITER9, state=RUNNABLE, group=TGRP-TestRealTimeGet]
	at __randomizedtesting.SeedInfo.seed([95DBDD57FD408A63:FD5D735DB33E9C1]:0)
Caused by: java.lang.RuntimeException: org.apache.solr.common.SolrException: Exception writing document id 74 to the index; possible analysis error.
	at __randomizedtesting.SeedInfo.seed([95DBDD57FD408A63]:0)
	at org.apache.solr.search.TestRealTimeGet$1.run(TestRealTimeGet.java:706)
Caused by: org.apache.solr.common.SolrException: Exception writing document id 74 to the index; possible analysis error.
	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246)
	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:67)
	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)
	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:950)
	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1163)
	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:633)
	at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103)
	at org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleAdds(JsonLoader.java:501)
	at org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:145)
	at org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:121)
	at org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:84)
	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2510)
	at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:125)
	at org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1286)
	at org.apache.solr.SolrTestCaseJ4.addAndGetVersion(SolrTestCaseJ4.java:1451)
	at org.apache.solr.search.TestRealTimeGet$1.run(TestRealTimeGet.java:675)
Caused by: java.lang.NullPointerException
	at org.apache.solr.update.UpdateLog.getCurrentLogSizeFromStream(UpdateLog.java:299)
	at org.apache.solr.update.DirectUpdateHandler2.getCurrentTLogSize(DirectUpdateHandler2.java:1007)
	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291)
	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:234)
	... 18 more




Build Log:
[...truncated 13884 lines...]
   [junit4] Suite: org.apache.solr.search.TestRealTimeGet
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.TestRealTimeGet_95DBDD57FD408A63-001/init-core-data-001
   [junit4]   2> 1609646 WARN  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=23 numCloses=23
   [junit4]   2> 1609646 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1609647 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1609648 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1609648 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.SolrTestCaseJ4 updateLog impl=solr.CdcrUpdateLog
   [junit4]   2> 1609649 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1609649 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1609670 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1609681 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=example
   [junit4]   2> 1609736 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.s.IndexSchema Loaded schema example/1.6 with uniqueid field id
   [junit4]   2> 1609776 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1eb2358
   [junit4]   2> 1609786 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1eb2358
   [junit4]   2> 1609786 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1eb2358
   [junit4]   2> 1609788 INFO  (coreLoadExecutor-6518-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1609789 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1609816 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1609829 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=example
   [junit4]   2> 1609884 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema example/1.6 with uniqueid field id
   [junit4]   2> 1609890 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 1609891 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1eb2358
   [junit4]   2> 1609891 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1609891 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.TestRealTimeGet_95DBDD57FD408A63-001/init-core-data-001/]
   [junit4]   2> 1609893 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8578497822447447]
   [junit4]   2> 1609896 WARN  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1609932 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 1609932 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1609932 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1609933 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1609933 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=70.6650390625, floorSegmentMB=1.87890625, forceMergeDeletesPctAllowed=22.517563974905855, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1609934 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@cacbb2[collection1] main]
   [junit4]   2> 1609934 WARN  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1609935 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1609936 INFO  (searcherExecutor-6519-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@cacbb2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1609936 INFO  (coreLoadExecutor-6518-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600799075872014336
   [junit4]   2> 1609938 INFO  (SUITE-TestRealTimeGet-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1609941 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testVersions
   [junit4]   2> 1609941 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1609942 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1dda32e[collection1] realtime]
   [junit4]   2> 1609942 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 1609942 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075878305792,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1609942 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075878305792
   [junit4]   2> 1609943 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@105392a[collection1] main]
   [junit4]   2> 1609943 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1609946 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@105392a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1609946 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 1609950 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1 (1600799075885645824)]} 0 1
   [junit4]   2> 1609951 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 1609951 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609951 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075887742976,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1609951 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075887742976
   [junit4]   2> 1609954 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ee769b[collection1] main]
   [junit4]   2> 1609954 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1609956 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ee769b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C1)))}
   [junit4]   2> 1609956 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 1609957 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609958 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[1 (1600799075885645834)]} 0 0
   [junit4]   2> 1609958 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609958 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[1 (1600799075885645833)]} 0 0
   [junit4]   2> 1609958 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609958 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&_version_=1600799075885645833&wt=json&indent=true}{delete=[1 (-1600799075885645833)]} 0 0
   [junit4]   2> 1609959 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609959 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075896131584,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1609959 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075896131584
   [junit4]   2> 1609960 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1666191[collection1] main]
   [junit4]   2> 1609961 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1609962 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1666191[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.4.0):C1)))}
   [junit4]   2> 1609963 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 1609963 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[1 (1600799075885645833)]} 0 0
   [junit4]   2> 1609963 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609964 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&_version_=1600799075885645833&wt=json&indent=true}{delete=[1 (-1600799075885645833)]} 0 0
   [junit4]   2> 1609964 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609964 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&_version_=1600799075885645839&wt=json&indent=true}{delete=[1 (-1600799075885645839)]} 0 0
   [junit4]   2> 1609965 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[1 (1600799075885645838)]} 0 0
   [junit4]   2> 1609965 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609965 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075902423040,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1609965 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075902423040
   [junit4]   2> 1609965 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@b5e81d[collection1] main]
   [junit4]   2> 1609966 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1609967 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@b5e81d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1609967 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 2
   [junit4]   2> 1609969 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=id:2 (-1600799075905568768)} 0 1
   [junit4]   2> 1609969 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609969 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2 (1600799075906617344)]} 0 0
   [junit4]   2> 1609971 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ac0e5e[collection1] realtime]
   [junit4]   2> 1609972 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@af13ad[collection1] realtime]
   [junit4]   2> 1609972 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=id:2 (-1600799075907665920)} 0 2
   [junit4]   2> 1609972 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=2&wt=xml} status=0 QTime=0
   [junit4]   2> 1609973 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[3 (1600799075907667020)]} 0 0
   [junit4]   2> 1609973 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[4 (1600799075907667120)]} 0 0
   [junit4]   2> 1609975 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ef0085[collection1] realtime]
   [junit4]   2> 1609976 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b228a7[collection1] realtime]
   [junit4]   2> 1609976 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&_version_=-1600799075907667070&versions=true&wt=json&indent=true}{deleteByQuery=id:(3 4 5 6) (-1600799075907667070)} 0 2
   [junit4]   2> 1609976 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=3&wt=xml} status=0 QTime=0
   [junit4]   2> 1609976 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=4&wt=xml} status=0 QTime=0
   [junit4]   2> 1609977 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[5 (1600799075907667121)]} 0 0
   [junit4]   2> 1609977 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 Reordered DBQs detected.  Update=add{_version_=1600799075907667021,id=6} DBQs=[DBQ{version=1600799075907667070,q=id:(3 4 5 6)}]
   [junit4]   2> 1609979 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@e104a2[collection1] realtime]
   [junit4]   2> 1609979 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[6 (1600799075907667021)]} 0 2
   [junit4]   2> 1609980 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=5&wt=xml} status=0 QTime=0
   [junit4]   2> 1609980 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=6&wt=xml} status=0 QTime=0
   [junit4]   2> 1609980 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075918151680,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1609980 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075918151680
   [junit4]   2> 1609980 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@cfcafa[collection1] main]
   [junit4]   2> 1609981 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1609982 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@cfcafa[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(7.4.0):C2/1:delGen=1) Uninverting(_4(7.4.0):C2/1:delGen=1)))}
   [junit4]   2> 1609983 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 2
   [junit4]   2> 1609984 INFO  (TEST-TestRealTimeGet.testVersions-seed#[95DBDD57FD408A63]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testVersions
   [junit4]   2> 1609986 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testOptimisticLocking
   [junit4]   2> 1609986 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1609987 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@9a2297[collection1] realtime]
   [junit4]   2> 1609987 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 1609987 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075925491712,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1609987 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075925491712
   [junit4]   2> 1609988 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@123bb59[collection1] main]
   [junit4]   2> 1609988 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1609989 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@123bb59[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1609990 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 2
   [junit4]   2> 1609991 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1 (1600799075928637440)]} 0 0
   [junit4]   2> 1609991 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609991 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075928637439&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609992 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-1600799075928637440&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609992 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075928637778&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609992 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075928637439&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609992 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-1600799075928637440&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609992 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075928637586&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609992 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075928637440&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-1&versions=true&wt=json&indent=true}{delete=[I_do_not_exist (-1600799075930734592)]} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1 (1600799075931783168)]} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075928637440&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075928637440&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075931783168&versions=true&wt=json&indent=true}{delete=[1 (-1600799075931783169)]} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075931783168&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1600799075931783168&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1609993 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-1600799075931783167&versions=true&wt=json&indent=true}{add=[1 (1600799075931783170)]} 0 0
   [junit4]   2> 1609994 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1609994 INFO  (TEST-TestRealTimeGet.testOptimisticLocking-seed#[95DBDD57FD408A63]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testOptimisticLocking
   [junit4]   2> 1609997 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGetRealtime
   [junit4]   2> 1609997 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1609998 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1295f53[collection1] realtime]
   [junit4]   2> 1609998 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 1609998 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075937026048,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1609998 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075937026048
   [junit4]   2> 1609999 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1efaf9e[collection1] main]
   [junit4]   2> 1609999 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1610000 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1efaf9e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1610000 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 2
   [junit4]   2> 1610003 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1 (1600799075941220352)]} 0 2
   [junit4]   2> 1610004 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 1610004 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id,+a_f,a_fd,a_fdS+++a_fs,a_fds,a_fdsS,++a_d,a_dd,a_ddS,++a_ds,a_dds,a_ddsS,++a_i,a_id,a_idS+++a_is,a_ids,a_idsS,+++a_l,a_ld,a_ldS+++a_ls,a_lds,a_ldsS&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1610005 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&ids=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1610005 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075944366080,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1610005 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075944366080
   [junit4]   2> 1610013 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b7c0a[collection1] main]
   [junit4]   2> 1610014 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1610015 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2b7c0a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_6(7.4.0):C1)))}
   [junit4]   2> 1610016 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 10
   [junit4]   2> 1610016 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 1610017 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id,+a_f,a_fd,a_fdS+++a_fs,a_fds,a_fdsS,++a_d,a_dd,a_ddS,++a_ds,a_dds,a_ddsS,++a_i,a_id,a_idS+++a_is,a_ids,a_idsS,+++a_l,a_ld,a_ldS+++a_ls,a_lds,a_ldsS&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1610018 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1610018 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&ids=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1610019 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{delete=[1 (-1600799075957997568)]} 0 0
   [junit4]   2> 1610019 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 1610020 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1610020 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=1&wt=xml} status=0 QTime=0
   [junit4]   2> 1610020 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[10 (1600799075960094720)]} 0 0
   [junit4]   2> 1610021 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[11 (1600799075961143296)]} 0 0
   [junit4]   2> 1610021 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=10&wt=xml} status=0 QTime=0
   [junit4]   2> 1610023 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@32ff98[collection1] realtime]
   [junit4]   2> 1610024 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e1964[collection1] realtime]
   [junit4]   2> 1610024 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{deleteByQuery=id:10 foo_s:abcdef (-1600799075962191872)} 0 2
   [junit4]   2> 1610025 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&id=10&wt=xml} status=0 QTime=0
   [junit4]   2> 1610025 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=11&wt=xml} status=0 QTime=0
   [junit4]   2> 1610026 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[12 (1600799075965337600)]} 0 0
   [junit4]   2> 1610026 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:12&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 1610026 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id,val_ls&id=12&wt=xml} status=0 QTime=0
   [junit4]   2> 1610027 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075967434752,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1610027 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075967434752
   [junit4]   2> 1610028 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2f85f[collection1] main]
   [junit4]   2> 1610029 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1610030 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2f85f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_7(7.4.0):C2/1:delGen=1) Uninverting(_8(7.4.0):C1)))}
   [junit4]   2> 1610031 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 1610031 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id,val_ls&id=12&wt=xml} status=0 QTime=0
   [junit4]   2> 1610032 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:12&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 1610033 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[12 (1600799075972677632)]} 0 1
   [junit4]   2> 1610034 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[13 (1600799075974774784)]} 0 0
   [junit4]   2> 1610034 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=11&fq=id:11&wt=xml} status=0 QTime=0
   [junit4]   2> 1610036 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1efc3b8[collection1] realtime]
   [junit4]   2> 1610036 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=12&fq=id:11&wt=xml} status=0 QTime=1
   [junit4]   2> 1610036 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=12&fq=id:13&wt=xml} status=0 QTime=0
   [junit4]   2> 1610037 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&id=12&fq=id:12&wt=xml} status=0 QTime=0
   [junit4]   2> 1610037 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[14 (1600799075977920512)]} 0 0
   [junit4]   2> 1610038 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[15 (1600799075978969088)]} 0 0
   [junit4]   2> 1610040 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@651c91[collection1] realtime]
   [junit4]   2> 1610041 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&ids=12,14,13,15&fq=id:[10+TO+14]&fq=id:[13+TO+19]&wt=xml} status=0 QTime=2
   [junit4]   2> 1610041 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[16 (1600799075982114816)]} 0 0
   [junit4]   2> 1610042 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[17 (1600799075983163392)]} 0 0
   [junit4]   2> 1610044 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ac716a[collection1] realtime]
   [junit4]   2> 1610045 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&ids=17,16,15,14&fq=id:[15+TO+16]&wt=xml} status=0 QTime=2
   [junit4]   2> 1610045 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&fl=id&ids=17,16,15,14&fq={!frange+l%3D15+u%3D16}id&wt=xml} status=0 QTime=0
   [junit4]   2> 1610046 INFO  (TEST-TestRealTimeGet.testGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGetRealtime
   [junit4]   2> 1610049 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStressGetRealtime
   [junit4]   2> 1610049 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1610049 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@bf6f36[collection1] realtime]
   [junit4]   2> 1610050 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 1
   [junit4]   2> 1610050 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799075991552000,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1610050 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@bf9952 commitCommandVersion:1600799075991552000
   [junit4]   2> 1610051 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@55ad4c[collection1] main]
   [junit4]   2> 1610051 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1610052 INFO  (searcherExecutor-6519-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@55ad4c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1610053 INFO  (TEST-TestRealTimeGet.testStressGetRealtime-seed#[95DBDD57FD408A63]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 2
   [junit4]   2> 1610057 INFO  (WRITER9) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1193577617&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1610057 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=913324772&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1610057 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1927281345&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1610057 INFO  (WRITER13) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=1591372899&versions=true&wt=json&indent=true}{} 0 0
   [junit4]   2> 1610057 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=0&versions=true&wt=json&indent=true}{delete=[67 (-1600799075998892036)]} 0 0
   [junit4]   2> 1610057 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[64 (-1600799075998892037)]} 0 0
   [junit4]   2> 1610057 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[58 (-1600799075998892035)]} 0 0
   [junit4]   2> 1610058 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=15} status=0 QTime=0
   [junit4]   2> 1610057 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[8 (-1600799075998892032)]} 0 0
   [junit4]   2> 1610058 INFO  (WRITER11) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[55 (1600799075998892040)]} 0 1
   [junit4]   2> 1610058 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=44} status=0 QTime=0
   [junit4]   2> 1610058 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=15} status=0 QTime=0
   [junit4]   2> 1610058 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=6} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=61} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=16} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=64} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=0&versions=true&wt=json&indent=true}{add=[5 (1600799075998892033)]} 0 2
   [junit4]   2> 1610059 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:34&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:55&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[74 (1600799075998892034)]} 0 2
   [junit4]   2> 1610059 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=63} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=55} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (WRITER10) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[37 (1600799075998892039)]} 0 2
   [junit4]   2> 1610059 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:14&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=0} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:55&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:34&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610058 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:15&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:66&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:55&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=55} status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:28&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:57&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610060 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:47&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610060 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:14&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610060 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:63&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610060 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:14&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610060 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:68&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610060 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:25&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610060 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:9&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610059 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=14} status=0 QTime=0
   [junit4]   2> 1610065 INFO  (WRITER12) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@173a7eb[collection1] realtime]
   [junit4]   2> 1610065 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=27} status=0 QTime=6
   [junit4]   2> 1610066 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:14&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610066 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=65} status=0 QTime=5
   [junit4]   2> 1610066 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=31} status=0 QTime=6
   [junit4]   2> 1610066 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=9} status=0 QTime=0
   [junit4]   2> 1610066 INFO  (WRITER12) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{deleteByQuery=id:29 (-1600799076000989185)} 0 8
   [junit4]   2> 1610067 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=55} status=0 QTime=6
   [junit4]   2> 1610067 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=45} status=0 QTime=7
   [junit4]   2> 1610067 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:26&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610067 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=754373366&versions=true&wt=json&indent=true}{} 0 9
   [junit4]   2> 1610067 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=14} status=0 QTime=0
   [junit4]   2> 1610067 INFO  (WRITER13) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7 (1600799076009377792)]} 0 9
   [junit4]   2> 1610067 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=14} status=0 QTime=0
   [junit4]   2> 1610067 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:72&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610067 INFO  (WRITER8) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=0&versions=true&wt=json&indent=true}{add=[18 (1600799075998892038)]} 0 10
   [junit4]   2> 1610067 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=2} status=0 QTime=0
   [junit4]   2> 1610067 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=14} status=0 QTime=7
   [junit4]   2> 1610068 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=35} status=0 QTime=0
   [junit4]   2> 1610068 INFO  (WRITER16) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[51 (1600799076010426368)]} 0 10
   [junit4]   2> 1610068 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[48 (1600799076010426369)]} 0 9
   [junit4]   2> 1610068 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=14} status=0 QTime=0
   [junit4]   2> 1610068 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=598215924&versions=true&wt=json&indent=true}{} 0 9
   [junit4]   2> 1610066 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=71} status=0 QTime=5
   [junit4]   2> 1610068 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=65} status=0 QTime=0
   [junit4]   2> 1610068 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=63} status=0 QTime=0
   [junit4]   2> 1610069 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=35} status=0 QTime=0
   [junit4]   2> 1610069 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:79&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610068 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=79} status=0 QTime=8
   [junit4]   2> 1610068 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=53} status=0 QTime=0
   [junit4]   2> 1610069 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:20&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610069 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[52 (1600799076011474944)]} 0 10
   [junit4]   2> 1610069 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:60&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610069 INFO  (WRITER17) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=765034781&versions=true&wt=json&indent=true}{} 0 10
   [junit4]   2> 1610068 INFO  (WRITER9) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[32 (1600799076009377793)]} 0 10
   [junit4]   2> 1610069 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=20} status=0 QTime=0
   [junit4]   2> 1610069 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:13&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610069 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[73 (1600799076011474945)]} 0 10
   [junit4]   2> 1610068 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=5} status=0 QTime=8
   [junit4]   2> 1610069 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:29&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610069 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=42} status=0 QTime=0
   [junit4]   2> 1610069 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[77 (1600799076011474946)]} 0 10
   [junit4]   2> 1610069 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610069 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=48} status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:70&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:44&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=77} status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=22} status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:22&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:70&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=24} status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:53&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:62&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:77&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=26} status=0 QTime=0
   [junit4]   2> 1610070 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=64} status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=26} status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:27&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=49} status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=10} status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=68} status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:17&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:43&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=47} status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:30&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610071 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=77} status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:39&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:19&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=32} status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=67} status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=60} status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:9&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:41&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:75&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=68} status=0 QTime=0
   [junit4]   2> 1610072 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:19&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=60} status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:77&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=38} status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=9} status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=43} status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=25} status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:18&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610067 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=72} status=0 QTime=7
   [junit4]   2> 1610073 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=17} status=0 QTime=0
   [junit4]   2> 1610067 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=64} status=0 QTime=7
   [junit4]   2> 1610067 INFO  (WRITER14) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[72 (1600799076008329216)]} 0 9
   [junit4]   2> 1610067 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=50} status=0 QTime=0
   [junit4]   2> 1610067 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=0&versions=true&wt=json&indent=true}{add=[79 (1600799076008329217)]} 0 9
   [junit4]   2> 1610073 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=15} status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:13&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:77&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610073 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=44} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=72} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=79} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=79} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=30} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=16} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=50} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:51&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=79} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=79} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=19} status=0 QTime=0
   [junit4]   2> 1610069 INFO  (WRITER10) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=0&versions=true&wt=json&indent=true}{add=[14 (1600799076011474947)]} 0 10
   [junit4]   2> 1610069 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=49} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:59&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610069 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=0&versions=true&wt=json&indent=true}{add=[59 (1600799076010426370)]} 0 10
   [junit4]   2> 1610074 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:11&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:79&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:79&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:48&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:5&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=78} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:11&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:44&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:67&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:13&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:52&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:45&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610074 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=59} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:13&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=14} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=66} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=69} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:9&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:44&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (WRITER11) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1600799076000989184,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 1610075 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=27} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=37} status=0 QTime=7
   [junit4]   2> 1610075 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:70&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER10) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=24} status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:31&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:45&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=47} status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=6} status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER7) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:52&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:58&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER5) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=61} status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:4&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610077 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:13&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610077 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:53&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610077 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=75} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=61} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:66&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=13} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=0} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=40} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=46} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=42} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=32} status=0 QTime=0
   [junit4]   2> 1610075 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=9} status=0 QTime=0
   [junit4]   2> 1610078 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:59&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610079 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=18} status=0 QTime=1
   [junit4]   2> 1610079 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:13&omitHeader=true&wt=json} hits=0 status=0 QTime=1
   [junit4]   2> 1610079 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=8} status=0 QTime=2
   [junit4]   2> 1610080 INFO  (READER6) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:13&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610080 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:31&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610080 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=62} status=0 QTime=0
   [junit4]   2> 1610077 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=37} status=0 QTime=0
   [junit4]   2> 1610080 INFO  (READER8) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:11&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 1610080 INFO  (READER4) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={wt=json&qt=/get&ids=67} status=0 QTime=0
   [junit4]   2> 1610076 INFO  (READER9) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:59&omitHeader=true&wt=json} hits=0 stat

[...truncated too long message...]

.1:36083_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.SearchRateTriggerTest-collection1.shard2.leader, tag=19cd441
   [junit4]   2> 2750304 INFO  (coreCloseExecutor-5097-thread-1) [n:127.0.0.1:39183_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.SearchRateTriggerTest-collection1.shard1.leader, tag=edd8c5
   [junit4]   2> 2750304 INFO  (jetty-closer-5857-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72182640427204619-127.0.0.1:34927_solr-n_0000000000) closing
   [junit4]   2> 2750304 INFO  (OverseerStateUpdate-72182640427204619-127.0.0.1:34927_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34927_solr
   [junit4]   2> 2750310 WARN  (OverseerAutoScalingTriggerThread-72182640427204619-127.0.0.1:34927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2750312 INFO  (jetty-closer-5857-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1ce3c6{/solr,null,UNAVAILABLE}
   [junit4]   2> 2750313 INFO  (jetty-closer-5857-thread-3) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 2750313 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10071baa19d000d, likely client has closed socket
   [junit4]   2> 2750314 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10071baa19d0010, likely client has closed socket
   [junit4]   2> 2750314 INFO  (zkCallback-5884-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39183_solr
   [junit4]   2> 2750314 INFO  (jetty-closer-5857-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@17120bb{/solr,null,UNAVAILABLE}
   [junit4]   2> 2750314 INFO  (jetty-closer-5857-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 2750314 INFO  (jetty-closer-5857-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@93c139{/solr,null,UNAVAILABLE}
   [junit4]   2> 2750314 INFO  (jetty-closer-5857-thread-4) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 2750315 ERROR (SUITE-SearchRateTriggerTest-seed#[95DBDD57FD408A63]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2750315 INFO  (SUITE-SearchRateTriggerTest-seed#[95DBDD57FD408A63]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37789 37789
   [junit4]   2> 2751103 INFO  (Thread-3041) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37789 37789
   [junit4]   2> 2751105 WARN  (Thread-3041) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/aliases.json
   [junit4]   2> 	12	/solr/collections/SearchRateTriggerTest-collection1/terms/shard1
   [junit4]   2> 	12	/solr/collections/SearchRateTriggerTest-collection1/terms/shard2
   [junit4]   2> 	8	/solr/configs/conf
   [junit4]   2> 	8	/solr/collections/SearchRateTriggerTest-collection2/terms/shard2
   [junit4]   2> 	8	/solr/collections/SearchRateTriggerTest-collection2/terms/shard1
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/clusterprops.json
   [junit4]   2> 	12	/solr/clusterstate.json
   [junit4]   2> 	8	/solr/collections/SearchRateTriggerTest-collection1/state.json
   [junit4]   2> 	4	/solr/collections/SearchRateTriggerTest-collection2/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72182640427204619-127.0.0.1:34927_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	21	/solr/collections
   [junit4]   2> 	12	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_95DBDD57FD408A63-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=cs, timezone=America/St_Vincent
   [junit4]   2> NOTE: Linux 4.13.0-39-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=171765744,total=360767488
   [junit4]   2> NOTE: All tests run in this JVM: [DataDrivenBlockJoinTest, TestSuggestSpellingConverter, TestFaceting, SolrMetricReporterTest, TestReloadDeadlock, TestSchemaVersionResource, TestSolrDeletionPolicy2, TestComplexPhraseLeadingWildcard, TestJavabinTupleStreamParser, HdfsUnloadDistributedZkTest, DateFieldTest, TestUtils, RestartWhileUpdatingTest, BlobRepositoryCloudTest, TestFieldCacheReopen, TestExactStatsCache, HdfsAutoAddReplicasIntegrationTest, TestFiltering, SpellCheckComponentTest, TestShortCircuitedRequests, TestFieldResource, TestApiFramework, SmileWriterTest, WrapperMergePolicyFactoryTest, TestDefaultStatsCache, TestPrepRecovery, TestRequestForwarding, LukeRequestHandlerTest, TestNonDefinedSimilarityFactory, ConvertedLegacyTest, DocValuesTest, TestTolerantSearch, SuggestComponentContextFilterQueryTest, TestCloudConsistency, TestNumericTokenStream, TestStressCloudBlindAtomicUpdates, FileBasedSpellCheckerTest, CacheHeaderTest, MetricUtilsTest, BufferStoreTest, TestNRTOpen, CoreAdminHandlerTest, TestSQLHandler, DistributedFacetPivotWhiteBoxTest, CreateCollectionCleanupTest, ConjunctionSolrSpellCheckerTest, TestLegacyFieldReuse, TestBackupRepositoryFactory, TestNoOpRegenerator, SolrIndexMetricsTest, DirectSolrSpellCheckerTest, BlockJoinFacetRandomTest, DistributedFacetSimpleRefinementLongTailTest, TestLFUCache, CoreAdminOperationTest, TestLMJelinekMercerSimilarityFactory, TestCollationFieldDocValues, TestImplicitCoreProperties, RegexBoostProcessorTest, TestUtilizeNode, HdfsSyncSliceTest, CollectionPropsTest, MinimalSchemaTest, TestAtomicUpdateErrorCases, TestObjectReleaseTracker, EnumFieldTest, MoreLikeThisHandlerTest, LeaderElectionIntegrationTest, DistributedSuggestComponentTest, AutoScalingHandlerTest, PeerSyncReplicationTest, TestCryptoKeys, RecoveryZkTest, TestQueryTypes, TestExportWriter, TestConfigSetProperties, BasicAuthStandaloneTest, TestCodecSupport, SearchHandlerTest, TestJettySolrRunner, TestSimpleTextCodec, TestSolrFieldCacheBean, TestDynamicFieldCollectionResource, SchemaApiFailureTest, CircularListTest, MetricTriggerIntegrationTest, CollectionsAPIAsyncDistributedZkTest, ResponseLogComponentTest, TestRandomDVFaceting, SpatialFilterTest, TestManagedSchemaAPI, LeaderFailureAfterFreshStartTest, NotRequiredUniqueKeyTest, DistanceFunctionTest, DistanceUnitsTest, TestUseDocValuesAsStored, TestDFRSimilarityFactory, TestMacroExpander, TestSimDistributedQueue, TestClusterStateProvider, TestBadConfig, TestTestInjection, URLClassifyProcessorTest, TestChildDocTransformer, MigrateRouteKeyTest, TestBulkSchemaConcurrent, SolrCloudExampleTest, TestSmileRequest, TestStressReorder, TestRawTransformer, HdfsChaosMonkeyNothingIsSafeTest, TestNumericTerms32, TestConfigReload, DistributedFacetPivotLongTailTest, TestSolrCloudSnapshots, SimpleMLTQParserTest, ClusterStateTest, TestSolrCoreProperties, TestPayloadScoreQParserPlugin, NumericFieldsTest, ClassificationUpdateProcessorFactoryTest, SaslZkACLProviderTest, TestSortByMinMaxFunction, ResponseBuilderTest, HDFSCollectionsAPITest, TestBlendedInfixSuggestions, CurrencyFieldTypeTest, TestSubQueryTransformerDistrib, TestMaxScoreQueryParser, BasicDistributedZkTest, TestRebalanceLeaders, TestTolerantUpdateProcessorRandomCloud, ZkShardTermsTest, AssignTest, CollectionReloadTest, CollectionTooManyReplicasTest, TestCollectionsAPIViaSolrCloudCluster, TestReplicaProperties, HttpTriggerListenerTest, NodeAddedTriggerTest, ScheduledTriggerIntegrationTest, SearchRateTriggerTest]
   [junit4] Completed [635/805 (2!)] on J2 in 42.06s, 3 tests, 1 failure <<< FAILURES!

[...truncated 46834 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1925/consoleText

[repro] Revision: fcae664e88110821647c1b28b0ad2c1d99ad3e13

[repro] Ant options: "-Dargs=-client -XX:+UseConcMarkSweepGC"
[repro] Repro line:  ant test  -Dtestcase=TestRealTimeGet -Dtests.method=testStressGetRealtime -Dtests.seed=95DBDD57FD408A63 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Africa/Tripoli -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] Repro line:  ant test  -Dtestcase=SearchRateTriggerTest -Dtests.method=testTrigger -Dtests.seed=95DBDD57FD408A63 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs -Dtests.timezone=America/St_Vincent -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestRealTimeGet
[repro]       SearchRateTriggerTest
[repro] ant compile-test

[...truncated 3316 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestRealTimeGet|*.SearchRateTriggerTest" -Dtests.showOutput=onerror "-Dargs=-client -XX:+UseConcMarkSweepGC" -Dtests.seed=95DBDD57FD408A63 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Africa/Tripoli -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 117 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
[repro]   0/5 failed: org.apache.solr.search.TestRealTimeGet
[repro] Exiting with code 0

[...truncated 40 lines...]