You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/04/02 15:11:35 UTC
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 536 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/536/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.TestStressInPlaceUpdates.stressTest
Error Message:
Captured an uncaught exception in thread: Thread[id=17376, name=WRITER5, state=RUNNABLE, group=TGRP-TestStressInPlaceUpdates]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=17376, name=WRITER5, state=RUNNABLE, group=TGRP-TestStressInPlaceUpdates]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:64048/_mnn/xo/collection1
at __randomizedtesting.SeedInfo.seed([8A2FF73C66692D72]:0)
at org.apache.solr.cloud.TestStressInPlaceUpdates$1.run(TestStressInPlaceUpdates.java:306)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:64048/_mnn/xo/collection1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.TestStressInPlaceUpdates.addDocAndGetVersion(TestStressInPlaceUpdates.java:549)
at org.apache.solr.cloud.TestStressInPlaceUpdates$1.run(TestStressInPlaceUpdates.java:254)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
at sun.security.ssl.InputRecord.read(InputRecord.java:503)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983)
at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:940)
at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 6 more
Build Log:
[...truncated 1793 lines...]
[junit4] JVM J1: stdout was not empty, see: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/build/core/test/temp/junit4-J1-20180402_133117_3206400638962145571072.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] codec: CheapBastard, pf: MockRandom, dvf: Asserting
[junit4] <<< JVM J1: EOF ----
[...truncated 11555 lines...]
[junit4] Suite: org.apache.solr.cloud.TestStressInPlaceUpdates
[junit4] 2> 1682179 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/init-core-data-001
[junit4] 2> 1682180 WARN (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
[junit4] 2> 1682180 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1682182 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1682183 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_mnn/xo
[junit4] 2> 1682184 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 1682185 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 1682234 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 1682244 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=inplace-updates
[junit4] 2> 1682248 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 1682292 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1682297 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1682297 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1682299 INFO (coreLoadExecutor-4853-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1682299 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 1682340 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 1682350 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=inplace-updates
[junit4] 2> 1682353 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 1682353 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 1682353 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1682354 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1682354 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/init-core-data-001/]
[junit4] 2> 1682355 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=669954033, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1682358 WARN (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1682425 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1682425 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1682426 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1682426 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1682427 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1682427 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1293011a[collection1] main]
[junit4] 2> 1682428 WARN (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 1682428 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1682428 INFO (coreLoadExecutor-4853-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596644140827803648
[junit4] 2> 1682429 INFO (searcherExecutor-4854-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1293011a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1682431 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 1682434 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1682434 INFO (Thread-3755) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1682434 INFO (Thread-3755) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1682437 ERROR (Thread-3755) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1682534 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.ZkTestServer start zk server on port:38582
[junit4] 2> 1682537 INFO (zkConnectionManagerCallback-5753-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1682543 INFO (zkConnectionManagerCallback-5755-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1682556 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1682559 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/schema-inplace-updates.xml to /configs/conf1/schema.xml
[junit4] 2> 1682561 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1682564 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1682566 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1682567 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1682569 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1682571 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1682573 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1682575 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1682577 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1682580 INFO (zkConnectionManagerCallback-5758-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1682581 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1682581 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10062b25d360002, likely client has closed socket
[junit4] 2> 1682912 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1682913 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1682913 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1682913 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1682915 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4613ecd2{/_mnn/xo,null,AVAILABLE}
[junit4] 2> 1682915 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@ce835af{SSL,[ssl, http/1.1]}{127.0.0.1:61816}
[junit4] 2> 1682915 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server Started @1684008ms
[junit4] 2> 1682915 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/tempDir-001/control/data, hostContext=/_mnn/xo, hostPort=61816, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/control-001/cores}
[junit4] 2> 1682915 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1682915 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1682916 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 1682916 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1682916 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1682916 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-02T14:15:10.036Z
[junit4] 2> 1682919 INFO (zkConnectionManagerCallback-5760-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1682920 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1682920 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/control-001/solr.xml
[junit4] 2> 1682923 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1682923 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1682924 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1682926 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38582/solr
[junit4] 2> 1682928 INFO (zkConnectionManagerCallback-5764-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1682930 INFO (zkConnectionManagerCallback-5766-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1683050 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1683050 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:61816__mnn%2Fxo
[junit4] 2> 1683051 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.c.Overseer Overseer (id=72166112245448709-127.0.0.1:61816__mnn%2Fxo-n_0000000000) starting
[junit4] 2> 1683061 INFO (zkConnectionManagerCallback-5771-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1683063 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38582/solr ready
[junit4] 2> 1683064 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61816__mnn%2Fxo
[junit4] 2> 1683066 INFO (zkCallback-5770-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1683071 INFO (OverseerStateUpdate-72166112245448709-127.0.0.1:61816__mnn%2Fxo-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1683465 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1683472 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1683472 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1683473 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/control-001/cores
[junit4] 2> 1683494 INFO (zkConnectionManagerCallback-5775-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1683495 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1683497 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38582/solr ready
[junit4] 2> 1683511 INFO (qtp758751950-17206) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61816__mnn%252Fxo&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1683514 INFO (OverseerThreadFactory-4866-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1683626 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1683627 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1683734 INFO (zkCallback-5765-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1684646 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 1684654 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=inplace-updates
[junit4] 2> 1684683 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 1684683 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1684684 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1684684 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1684684 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1684686 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=669954033, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1684688 WARN (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1684736 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1684736 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1684737 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1684737 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1684738 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1684738 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@36d2c089[control_collection_shard1_replica_n1] main]
[junit4] 2> 1684740 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1684740 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1684741 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1684741 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596644143253159936
[junit4] 2> 1684742 INFO (searcherExecutor-4869-thread-1-processing-n:127.0.0.1:61816__mnn%2Fxo x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@36d2c089[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1684746 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1684750 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1684751 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1684751 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:61816/_mnn/xo/control_collection_shard1_replica_n1/
[junit4] 2> 1684751 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1684751 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:61816/_mnn/xo/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1684751 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1684755 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:61816/_mnn/xo/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1684861 INFO (zkCallback-5765-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1684910 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1684913 INFO (qtp758751950-17204) [n:127.0.0.1:61816__mnn%2Fxo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1286
[junit4] 2> 1684916 INFO (qtp758751950-17206) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1685014 INFO (zkCallback-5765-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1685517 INFO (OverseerCollectionConfigSetProcessor-72166112245448709-127.0.0.1:61816__mnn%2Fxo-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1685917 INFO (qtp758751950-17206) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61816__mnn%252Fxo&wt=javabin&version=2} status=0 QTime=2406
[junit4] 2> 1685958 INFO (zkConnectionManagerCallback-5779-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1685960 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1685961 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38582/solr ready
[junit4] 2> 1685961 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1685965 INFO (qtp758751950-17207) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1685974 INFO (OverseerThreadFactory-4866-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1685976 WARN (OverseerThreadFactory-4866-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1686192 INFO (qtp758751950-17207) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1686193 INFO (qtp758751950-17207) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=228
[junit4] 2> 1686747 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-1-001 of type NRT
[junit4] 2> 1686755 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1686757 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1686757 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1686757 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1686757 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58d0662b{/_mnn/xo,null,AVAILABLE}
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6c06a4c7{SSL,[ssl, http/1.1]}{127.0.0.1:64048}
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server Started @1687851ms
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/_mnn/xo, hostPort=64048, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-1-001/cores}
[junit4] 2> 1686758 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1686758 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-02T14:15:13.878Z
[junit4] 2> 1686778 INFO (zkConnectionManagerCallback-5781-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1686780 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1686780 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-1-001/solr.xml
[junit4] 2> 1686784 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1686784 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1686785 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1686803 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38582/solr
[junit4] 2> 1686805 INFO (zkConnectionManagerCallback-5785-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1686810 INFO (zkConnectionManagerCallback-5787-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1686844 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1686849 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1686869 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1686870 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64048__mnn%2Fxo
[junit4] 2> 1686871 INFO (zkCallback-5765-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1686872 INFO (zkCallback-5770-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1686873 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1686900 INFO (zkCallback-5778-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1687229 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1687240 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1687240 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1687242 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-1-001/cores
[junit4] 2> 1687246 INFO (zkConnectionManagerCallback-5792-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1687248 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1687249 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38582/solr ready
[junit4] 2> 1687282 INFO (qtp758751950-17206) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:64048__mnn%252Fxo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1687287 INFO (OverseerCollectionConfigSetProcessor-72166112245448709-127.0.0.1:61816__mnn%2Fxo-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1687289 INFO (OverseerThreadFactory-4866-thread-3) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:64048__mnn%2Fxo for creating new replica
[junit4] 2> 1687316 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1687424 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1688339 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 1688348 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.IndexSchema [collection1_shard1_replica_n21] Schema name=inplace-updates
[junit4] 2> 1688364 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 1688364 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n21' using configuration from collection collection1, trusted=true
[junit4] 2> 1688366 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n21' (registry 'solr.core.collection1.shard1.replica_n21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1688366 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1688366 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore [[collection1_shard1_replica_n21] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-1-001/cores/collection1_shard1_replica_n21], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-1-001/cores/collection1_shard1_replica_n21/data/]
[junit4] 2> 1688368 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=669954033, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1688370 WARN (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1688427 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1688427 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1688428 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1688428 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1688429 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1688429 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b89a5f7[collection1_shard1_replica_n21] main]
[junit4] 2> 1688430 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1688431 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1688431 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1688431 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596644147122405376
[junit4] 2> 1688432 INFO (searcherExecutor-4880-thread-1-processing-n:127.0.0.1:64048__mnn%2Fxo x:collection1_shard1_replica_n21 c:collection1 s:shard1) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore [collection1_shard1_replica_n21] Registered new searcher Searcher@3b89a5f7[collection1_shard1_replica_n21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1688438 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node22=0}, version=0}
[junit4] 2> 1688441 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1688441 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1688441 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:64048/_mnn/xo/collection1_shard1_replica_n21/
[junit4] 2> 1688441 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1688441 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy https://127.0.0.1:64048/_mnn/xo/collection1_shard1_replica_n21/ has no replicas
[junit4] 2> 1688441 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1688445 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:64048/_mnn/xo/collection1_shard1_replica_n21/ shard1
[junit4] 2> 1688547 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1688604 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1688608 INFO (qtp1835083377-17259) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1292
[junit4] 2> 1688614 INFO (qtp758751950-17206) [n:127.0.0.1:61816__mnn%2Fxo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:64048__mnn%252Fxo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1333
[junit4] 2> 1688717 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1689293 INFO (OverseerCollectionConfigSetProcessor-72166112245448709-127.0.0.1:61816__mnn%2Fxo-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1689388 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-2-001 of type NRT
[junit4] 2> 1689392 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1689394 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1689394 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1689394 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1689395 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a31cf5a{/_mnn/xo,null,AVAILABLE}
[junit4] 2> 1689395 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@179ede6b{SSL,[ssl, http/1.1]}{127.0.0.1:32827}
[junit4] 2> 1689395 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server Started @1690489ms
[junit4] 2> 1689395 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/_mnn/xo, hostPort=32827, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-2-001/cores}
[junit4] 2> 1689396 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1689397 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1689397 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 1689397 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1689397 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1689397 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-02T14:15:16.517Z
[junit4] 2> 1689399 INFO (zkConnectionManagerCallback-5794-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1689401 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1689401 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-2-001/solr.xml
[junit4] 2> 1689404 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1689404 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1689404 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1689411 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38582/solr
[junit4] 2> 1689413 INFO (zkConnectionManagerCallback-5798-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1689417 INFO (zkConnectionManagerCallback-5800-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1689432 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1689438 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1689442 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1689442 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32827__mnn%2Fxo
[junit4] 2> 1689444 INFO (zkCallback-5770-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1689444 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1689444 INFO (zkCallback-5765-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1689445 INFO (zkCallback-5778-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1689445 INFO (zkCallback-5791-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1689445 INFO (zkCallback-5799-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1690686 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1690696 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1690696 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1690698 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-2-001/cores
[junit4] 2> 1690710 INFO (zkConnectionManagerCallback-5805-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1690711 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1690713 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38582/solr ready
[junit4] 2> 1690808 INFO (qtp50766928-17293) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:32827__mnn%252Fxo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1690817 INFO (OverseerThreadFactory-4866-thread-4) [ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:32827__mnn%2Fxo for creating new replica
[junit4] 2> 1690827 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1690859 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1690860 INFO (zkCallback-5799-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1691871 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
[junit4] 2> 1691893 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.IndexSchema [collection1_shard1_replica_n23] Schema name=inplace-updates
[junit4] 2> 1691897 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 1691897 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n23' using configuration from collection collection1, trusted=true
[junit4] 2> 1691898 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n23' (registry 'solr.core.collection1.shard1.replica_n23') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1691898 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1691898 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrCore [[collection1_shard1_replica_n23] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-2-001/cores/collection1_shard1_replica_n23], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-2-001/cores/collection1_shard1_replica_n23/data/]
[junit4] 2> 1691900 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=669954033, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1691903 WARN (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1691970 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1691970 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1691972 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1691972 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1691972 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1691973 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.SolrIndexSearcher Opening [Searcher@7d3f89b1[collection1_shard1_replica_n23] main]
[junit4] 2> 1691974 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1691975 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1691975 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1691976 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596644150839607296
[junit4] 2> 1691977 INFO (searcherExecutor-4891-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrCore [collection1_shard1_replica_n23] Registered new searcher Searcher@7d3f89b1[collection1_shard1_replica_n23] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1691980 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node24=0, core_node22=0}, version=1}
[junit4] 2> 1691982 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_n23
[junit4] 2> 1691982 INFO (updateExecutor-5795-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1691983 INFO (qtp50766928-17291) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1156
[junit4] 2> 1691983 INFO (recoveryExecutor-5796-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1 r:core_node24) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1691983 INFO (recoveryExecutor-5796-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1 r:core_node24) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1691986 INFO (qtp50766928-17293) [n:127.0.0.1:32827__mnn%2Fxo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:32827__mnn%252Fxo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1177
[junit4] 2> 1691990 INFO (qtp1835083377-17257) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] o.a.s.c.S.Request [collection1_shard1_replica_n21] webapp=/_mnn/xo path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1691990 INFO (qtp1835083377-17257) [n:127.0.0.1:64048__mnn%2Fxo c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] o.a.s.c.S.Request [collection1_shard1_replica_n21] webapp=/_mnn/xo path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1691991 INFO (recoveryExecutor-5796-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1 r:core_node24) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_n23]
[junit4] 2> 1691991 INFO (recoveryExecutor-5796-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1 r:core_node24) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1691991 INFO (recoveryExecutor-5796-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1 r:core_node24) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_n23] as recovering, leader is [https://127.0.0.1:64048/_mnn/xo/collection1_shard1_replica_n21/] and I am [https://127.0.0.1:32827/_mnn/xo/collection1_shard1_replica_n23/]
[junit4] 2> 1691992 INFO (recoveryExecutor-5796-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1 r:core_node24) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node24_recovering=0, core_node24=0, core_node22=0}, version=2}
[junit4] 2> 1691994 INFO (recoveryExecutor-5796-thread-1-processing-n:127.0.0.1:32827__mnn%2Fxo x:collection1_shard1_replica_n23 c:collection1 s:shard1 r:core_node24) [n:127.0.0.1:32827__mnn%2Fxo c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:64048/_mnn/xo]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_n21&nodeName=127.0.0.1:32827__mnn%252Fxo&coreNodeName=core_node24&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1691998 INFO (qtp1835083377-17257) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 1691999 INFO (qtp1835083377-17257) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:32827__mnn%2Fxo, coreNodeName=core_node24, onlyIfActiveCheckResult=false, nodeProps: core_node24:{"core":"collection1_shard1_replica_n23","base_url":"https://127.0.0.1:32827/_mnn/xo","node_name":"127.0.0.1:32827__mnn%2Fxo","state":"down","type":"NRT"}
[junit4] 2> 1692096 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1692096 INFO (zkCallback-5799-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1692292 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-3-001 of type NRT
[junit4] 2> 1692294 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1692295 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1692295 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1692295 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1692295 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@80afe3b{/_mnn/xo,null,AVAILABLE}
[junit4] 2> 1692296 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4068ab7b{SSL,[ssl, http/1.1]}{127.0.0.1:47114}
[junit4] 2> 1692296 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.e.j.s.Server Started @1693391ms
[junit4] 2> 1692296 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/_mnn/xo, hostPort=47114, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-3-001/cores}
[junit4] 2> 1692296 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1692297 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1692297 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.4.0
[junit4] 2> 1692297 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1692297 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1692297 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-02T14:15:19.417Z
[junit4] 2> 1692299 INFO (zkConnectionManagerCallback-5808-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1692300 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1692300 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-3-001/solr.xml
[junit4] 2> 1692302 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1692302 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1692303 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1692306 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38582/solr
[junit4] 2> 1692308 INFO (zkConnectionManagerCallback-5812-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1692309 INFO (zkConnectionManagerCallback-5814-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1692324 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1692327 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1692331 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1692331 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47114__mnn%2Fxo
[junit4] 2> 1692333 INFO (zkCallback-5770-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692333 INFO (zkCallback-5765-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692333 INFO (zkCallback-5791-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692333 INFO (zkCallback-5778-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692333 INFO (zkCallback-5799-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692333 INFO (zkCallback-5804-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692334 INFO (zkCallback-5786-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692334 INFO (zkCallback-5813-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1692815 INFO (OverseerCollectionConfigSetProcessor-72166112245448709-127.0.0.1:61816__mnn%2Fxo-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1692973 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1692981 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1692981 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@461eef2b
[junit4] 2> 1692983 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001/shard-3-001/cores
[junit4] 2> 1692988 INFO (zkConnectionManagerCallback-5819-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1692990 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1692992 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[8A2FF73C66692D72]) [n:127.0.0.1:47114__mnn%2Fxo ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38582/solr ready
[junit4] 2> 1693000 INFO (qtp1835083377-17257) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:32827__mnn%2Fxo, coreNodeName=core_node24, onlyIfActiveCheckResult=false, nodeProps: core_node24:{"core":"collection1_shard1_replica_n23","base_url":"https://127.0.0.1:32827/_mnn/xo","node_name":"127.0.0.1:32827__mnn%2Fxo","state":"recovering","type":"NRT"}
[junit4] 2> 1693000 INFO (qtp1835083377-17257) [n:127.0.0.1:64048__mnn%2Fxo ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: t
[...truncated too long message...]
mpl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] > at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] > at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] > at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] > at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] > ... 6 more
[junit4] 2> 1721969 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 1721969 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=741262001
[junit4] 2> 1721969 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1721969 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@56deea76: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@53a29bf1
[junit4] 2> 1721970 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1721970 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@41ace375: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@59b6f44
[junit4] 2> 1721970 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1721970 INFO (SUITE-TestStressInPlaceUpdates-seed#[8A2FF73C66692D72]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18460cbf: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@30025982
[junit4] 2> 1721971 INFO (coreCloseExecutor-4923-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@58eb5d02
[junit4] 2> 1721971 INFO (coreCloseExecutor-4923-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1491819778
[junit4] 2> 1721971 INFO (coreCloseExecutor-4923-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@37e56c12: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@3022b798
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_8A2FF73C66692D72-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {title_s=Lucene50(blocksize=128), id=BlockTreeOrds(blocksize=128), id_field_copy_that_does_not_support_in_place_update_s=Lucene50(blocksize=128)}, docValues:{val1_i_dvo=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Asserting), val2_l_dvo=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Memory), inplace_updatable_int_with_default=DocValuesFormat(name=Direct), inplace_updatable_float_with_default=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=2022, maxMBSortInHeap=7.412410508830909, sim=RandomSimilarity(queryNorm=false): {}, locale=is-IS, timezone=Africa/Johannesburg
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=139638472,total=528482304
[junit4] 2> NOTE: All tests run in this JVM: [SuggesterWFSTTest, TestGenericDistributedQueue, HLLUtilTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestSearchPerf, PropertiesRequestHandlerTest, DistributedQueueTest, TestFieldCollectionResource, TestHashPartitioner, HdfsAutoAddReplicasIntegrationTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, OverseerTest, BigEndianAscendingWordDeserializerTest, TestAnalyzedSuggestions, TestFieldCacheReopen, TestHighFrequencyDictionaryFactory, TestSolrCloudSnapshots, TestRequestForwarding, CdcrReplicationDistributedZkTest, ScheduledMaintenanceTriggerTest, UpdateParamsTest, TestComponentsName, NodeMarkersRegistrationTest, TestFastLRUCache, SystemInfoHandlerTest, FullSolrCloudDistribCmdsTest, TestDistributedMissingSort, SolrMetricReporterTest, BlockJoinFacetSimpleTest, TestStressVersions, LeaderFailureAfterFreshStartTest, TestSQLHandler, TestDelegationWithHadoopAuth, HdfsCollectionsAPIDistributedZkTest, SortByFunctionTest, TestIntervalFaceting, SolrCLIZkUtilsTest, TestClusterStateProvider, DistanceFunctionTest, IndexBasedSpellCheckerTest, TestInfoStreamLogging, MinimalSchemaTest, CdcrRequestHandlerTest, ZkShardTermsTest, BasicDistributedZk2Test, TestSolrCoreProperties, TestAtomicUpdateErrorCases, JvmMetricsTest, TestDistributedSearch, TestPullReplicaErrorHandling, TestDistribDocBasedVersion, FieldAnalysisRequestHandlerTest, SpatialRPTFieldTypeTest, TestPrepRecovery, TestRandomRequestDistribution, TestApiFramework, TestFieldCacheSortRandom, CSVRequestHandlerTest, TestExportWriter, DocValuesNotIndexedTest, UUIDFieldTest, TestSimpleTrackingShardHandler, SimpleCollectionCreateDeleteTest, CdcrBidirectionalTest, OverseerCollectionConfigSetProcessorTest, TestSolr4Spatial2, TestSystemCollAutoCreate, IndexSchemaTest, OverseerTaskQueueTest, ChaosMonkeySafeLeaderTest, TestLeaderElectionWithEmptyReplica, TestNumericTokenStream, StressHdfsTest, ChaosMonkeyNothingIsSafeTest, MetricUtilsTest, TestUseDocValuesAsStored2, HighlighterConfigTest, AutoAddReplicasPlanActionTest, HDFSCollectionsAPITest, TestReloadDeadlock, JavabinLoaderTest, TestManagedResourceStorage, TestDynamicFieldCollectionResource, TestStressRecovery, TestDFISimilarityFactory, TestGraphMLResponseWriter, HdfsDirectoryTest, TestCloudNestedDocsSort, MergeStrategyTest, ImplicitSnitchTest, BadIndexSchemaTest, ZkStateReaderTest, TestRandomDVFaceting, TestSubQueryTransformerDistrib, TestAuthorizationFramework, TestWordDelimiterFilterFactory, TestSolrCloudWithHadoopAuthPlugin, TestFieldCacheWithThreads, TestSolrCloudWithSecureImpersonation, NoCacheHeaderTest, DocumentAnalysisRequestHandlerTest, ReplaceNodeNoTargetTest, QueryParsingTest, TestRTGBase, PrimUtilsTest, RollingRestartTest, TestXmlQParser, TestLegacyTerms, SimpleMLTQParserTest, TestSolrQueryParser, TestSolrQueryResponse, TestRandomCollapseQParserPlugin, DebugComponentTest, TestBinaryResponseWriter, ConcurrentDeleteAndCreateCollectionTest, DeleteStatusTest, DistributedSpellCheckComponentTest, CloneFieldUpdateProcessorFactoryTest, RequestLoggingTest, TimeRoutedAliasUpdateProcessorTest, DistributedTermsComponentTest, HdfsDirectoryFactoryTest, SliceStateTest, TestStressLucene, TestSort, TimeZoneUtilsTest, DeleteLastCustomShardedReplicaTest, HdfsThreadLeakTest, DisMaxRequestHandlerTest, SolrJmxReporterCloudTest, CursorMarkTest, DirectUpdateHandlerTest, TestSizeLimitedDistributedMap, TestConfigSetsAPIExclusivity, TestFileDictionaryLookup, AddReplicaTest, TestInitQParser, AssignBackwardCompatibilityTest, FacetPivotSmallTest, ClusterStateTest, TestSimpleQParserPlugin, TestCloudConsistency, TriggerIntegrationTest, TestSortByMinMaxFunction, LegacyCloudClusterPropTest, CustomHighlightComponentTest, SolrShardReporterTest, OverseerRolesTest, RecoveryAfterSoftCommitTest, TestStressUserVersions, ResponseLogComponentTest, PreAnalyzedFieldTest, TestCollapseQParserPlugin, TestJsonFacets, MetricTriggerIntegrationTest, TestEmbeddedSolrServerAdminHandler, HdfsChaosMonkeySafeLeaderTest, TestEmbeddedSolrServerSchemaAPI, DefaultValueUpdateProcessorTest, TestSolrIndexConfig, ScriptEngineTest, FullHLLTest, NodeLostTriggerIntegrationTest, CloudExitableDirectoryReaderTest, TestMinMaxOnMultiValuedField, ExternalFileFieldSortTest, TestConfigReload, TestStressInPlaceUpdates]
[junit4] Completed [363/794 (1!)] on J1 in 39.84s, 1 test, 1 error <<< FAILURES!
[...truncated 51104 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/536/consoleText
[repro] Revision: a2fcb8c9ed4a8e7fd0c23829c089573558a987f0
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=TestStressInPlaceUpdates -Dtests.method=stressTest -Dtests.seed=8A2FF73C66692D72 -Dtests.slow=true -Dtests.locale=is-IS -Dtests.timezone=Africa/Johannesburg -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestStressInPlaceUpdates
[repro] ant compile-test
[...truncated 3335 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestStressInPlaceUpdates" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=8A2FF73C66692D72 -Dtests.slow=true -Dtests.locale=is-IS -Dtests.timezone=Africa/Johannesburg -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 70 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.TestStressInPlaceUpdates
[repro] Exiting with code 0
[...truncated 70 lines...]