You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/04/30 01:42:49 UTC

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1537 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1537/

5 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=17801, name=testExecutor-5389-thread-2, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=17801, name=testExecutor-5389-thread-2, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:37065/fcbyv/pf
	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B]:0)
	at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$0(BasicDistributedZkTest.java:596)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:37065/fcbyv/pf
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$0(BasicDistributedZkTest.java:594)
	... 4 more
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 9 more


FAILED:  org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit

Error Message:
GC overhead limit exceeded

Stack Trace:
java.lang.OutOfMemoryError: GC overhead limit exceeded
	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B:3E5E8D5A8AC9339C]:0)
	at java.util.Arrays.copyOfRange(Arrays.java:3664)
	at java.lang.String.<init>(String.java:207)
	at java.lang.String.substring(String.java:1933)
	at java.lang.Class.getSimpleName(Class.java:1312)
	at org.apache.lucene.index.ConcurrentMergeScheduler.toString(ConcurrentMergeScheduler.java:727)
	at java.lang.String.valueOf(String.java:2994)
	at java.lang.StringBuilder.append(StringBuilder.java:131)
	at org.apache.lucene.index.LiveIndexWriterConfig.toString(LiveIndexWriterConfig.java:478)
	at org.apache.lucene.index.IndexWriterConfig.toString(IndexWriterConfig.java:479)
	at org.apache.lucene.util.LuceneTestCase.maybeChangeLiveIndexWriterConfig(LuceneTestCase.java:1161)
	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:152)
	at org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit(TestDocTermOrdsUninvertLimit.java:64)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)


FAILED:  junit.framework.TestSuite.org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit

Error Message:
Captured an uncaught exception in thread: Thread[id=11424, name=Lucene Merge Thread #44, state=RUNNABLE, group=TGRP-TestDocTermOrdsUninvertLimit]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11424, name=Lucene Merge Thread #44, state=RUNNABLE, group=TGRP-TestDocTermOrdsUninvertLimit]
Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: GC overhead limit exceeded
	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B]:0)
	at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
	at org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
	at org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
	at org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
	at org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
	at org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4824)
	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4327)
	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3922)
	at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)


FAILED:  org.apache.solr.update.TestInPlaceUpdatesDistrib.test

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.update.TestInPlaceUpdatesDistrib

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B]:0)




Build Log:
[...truncated 14568 lines...]
   [junit4] Suite: org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDocTermOrdsUninvertLimit -Dtests.method=testTriggerUnInvertLimit -Dtests.seed=DECA59E877EE92B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=uk-UA -Dtests.timezone=Etc/GMT+0 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR    129s J1 | TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B:3E5E8D5A8AC9339C]:0)
   [junit4]    > 	at java.util.Arrays.copyOfRange(Arrays.java:3664)
   [junit4]    > 	at java.lang.String.<init>(String.java:207)
   [junit4]    > 	at java.lang.String.substring(String.java:1933)
   [junit4]    > 	at java.lang.Class.getSimpleName(Class.java:1312)
   [junit4]    > 	at org.apache.lucene.index.ConcurrentMergeScheduler.toString(ConcurrentMergeScheduler.java:727)
   [junit4]    > 	at java.lang.String.valueOf(String.java:2994)
   [junit4]    > 	at java.lang.StringBuilder.append(StringBuilder.java:131)
   [junit4]    > 	at org.apache.lucene.index.LiveIndexWriterConfig.toString(LiveIndexWriterConfig.java:478)
   [junit4]    > 	at org.apache.lucene.index.IndexWriterConfig.toString(IndexWriterConfig.java:479)
   [junit4]    > 	at org.apache.lucene.util.LuceneTestCase.maybeChangeLiveIndexWriterConfig(LuceneTestCase.java:1161)
   [junit4]    > 	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:152)
   [junit4]    > 	at org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit(TestDocTermOrdsUninvertLimit.java:64)
   [junit4]   2> Apr 29, 2018 11:35:18 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Apr 29, 2018 11:35:18 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #44,5,TGRP-TestDocTermOrdsUninvertLimit]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B]:0)
   [junit4]   2> 	at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]   2> 	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]   2> 	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
   [junit4]   2> 	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
   [junit4]   2> 	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
   [junit4]   2> 	at org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
   [junit4]   2> 	at org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
   [junit4]   2> 	at org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]   2> 	at org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4824)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4327)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3922)
   [junit4]   2> 	at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]   2> 	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@15cf893d), locale=uk-UA, timezone=Etc/GMT+0
   [junit4]   2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=101123400,total=477626368
   [junit4]   2> NOTE: All tests run in this JVM: [TestSchemalessBufferedUpdates, TestDistributedGrouping, HdfsDirectoryFactoryTest, TestTriggerIntegration, SOLR749Test, LeaderVoteWaitTimeoutTest, DirectSolrConnectionTest, ZkStateReaderTest, TestSystemIdResolver, TestSizeLimitedDistributedMap, TestManagedResource, SchemaVersionSpecificBehaviorTest, CoreAdminRequestStatusTest, DistributedMLTComponentTest, DOMUtilTest, SystemLogListenerTest, FacetPivotSmallTest, HdfsDirectoryTest, SolrXmlInZkTest, TestSerializedLuceneMatchVersion, RuleEngineTest, TestNodeLostTrigger, QueryEqualityTest, TestQueryWrapperFilter, ChaosMonkeySafeLeaderWithPullReplicasTest, CSVRequestHandlerTest, ActionThrottleTest, TestFastLRUCache, NodeLostTriggerIntegrationTest, OverseerStatusTest, TestSolr4Spatial2, TestMacros, TestReversedWildcardFilterFactory, TestCursorMarkWithoutUniqueKey, ComputePlanActionTest, SimplePostToolTest, TestSQLHandlerNonCloud, TestSubQueryTransformer, ShufflingReplicaListTransformerTest, SliceStateTest, CoreSorterTest, TestSlowCompositeReaderWrapper, SearchHandlerTest, QueryParsingTest, CollectionsAPIDistributedZkTest, TestLuceneIndexBackCompat, PathHierarchyTokenizerFactoryTest, HdfsBasicDistributedZk2Test, TestMinMaxOnMultiValuedField, BJQParserTest, TestPostingsSolrHighlighter, ShardRoutingCustomTest, ReplaceNodeTest, TestOverriddenPrefixQueryForCustomFieldType, TestCharFilters, SolrCoreMetricManagerTest, MetricTriggerTest, TestFieldTypeCollectionResource, TestInfoStreamLogging, TestCloudSearcherWarming, TestReplicationHandler, TestImpersonationWithHadoopAuth, HdfsCollectionsAPIDistributedZkTest, TestMissingGroups, ScheduledTriggerTest, LeaderElectionContextKeyTest, TestBinaryResponseWriter, TestBulkSchemaAPI, TestFieldCacheWithThreads, JavabinLoaderTest, TestNumericTerms64, ClassificationUpdateProcessorTest, SampleTest, TestCloudPivotFacet, SoftAutoCommitTest, BlockJoinFacetSimpleTest, DateRangeFieldTest, TestManagedSynonymFilterFactory, MetricUtilsTest, XsltUpdateRequestHandlerTest, TestComputePlanAction, TestRandomRequestDistribution, MergeStrategyTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestZkChroot, TestElisionMultitermQuery, TestInitQParser, TermsComponentTest, SegmentsInfoRequestHandlerTest, TestReload, TestDynamicFieldResource, TestNumericRangeQuery32, HdfsThreadLeakTest, TestSearcherReuse, TlogReplayBufferedWhileIndexingTest, TestPartialUpdateDeduplication, TestFileDictionaryLookup, TestDocTermOrdsUninvertLimit]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDocTermOrdsUninvertLimit -Dtests.seed=DECA59E877EE92B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=uk-UA -Dtests.timezone=Etc/GMT+0 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestDocTermOrdsUninvertLimit (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11424, name=Lucene Merge Thread #44, state=RUNNABLE, group=TGRP-TestDocTermOrdsUninvertLimit]
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DECA59E877EE92B]:0)
   [junit4]    > 	at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]    > 	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]    > 	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
   [junit4]    > 	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
   [junit4]    > 	at org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
   [junit4]    > 	at org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]    > 	at org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4824)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4327)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3922)
   [junit4]    > 	at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]    > 	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4] Completed [310/804 (1!)] on J1 in 129.33s, 1 test, 2 errors <<< FAILURES!

[...truncated 655 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/init-core-data-001
   [junit4]   2> 5997399 INFO  (SUITE-BasicDistributedZkTest-seed#[DECA59E877EE92B]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /fcbyv/pf
   [junit4]   2> 5997408 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 5997427 INFO  (Thread-6409) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 5997427 INFO  (Thread-6409) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 5997518 ERROR (Thread-6409) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 5997540 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.ZkTestServer start zk server on port:33262
   [junit4]   2> 5997579 INFO  (zkConnectionManagerCallback-3634-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 5997614 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101b8268ae20000, likely client has closed socket
   [junit4]   2> 5997678 INFO  (zkConnectionManagerCallback-3636-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 5997709 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 5997711 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 5997724 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 5997725 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 5997726 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 5997727 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 5997760 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 5997761 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 5997762 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 5997762 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 5997763 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 5997788 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 5998398 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 5998399 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 5998399 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 5998399 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 5998401 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d5aa1bd{/fcbyv/pf,null,AVAILABLE}
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@955547e{HTTP/1.1,[http/1.1]}{127.0.0.1:32793}
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server Started @5998616ms
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/tempDir-001/control/data, replicaType=NRT, hostContext=/fcbyv/pf, hostPort=32793, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/control-001/cores}
   [junit4]   2> 5998419 ERROR (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 5998419 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-04-30T00:11:40.997Z
   [junit4]   2> 5998447 INFO  (zkConnectionManagerCallback-3638-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 5998471 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 5998471 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/control-001/solr.xml
   [junit4]   2> 5998474 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 5998474 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 5998476 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 5998499 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33262/solr
   [junit4]   2> 5998536 INFO  (zkConnectionManagerCallback-3642-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 5998576 INFO  (zkConnectionManagerCallback-3644-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6000137 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 6000138 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32793_fcbyv%2Fpf
   [junit4]   2> 6000138 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.c.Overseer Overseer (id=72541544692973572-127.0.0.1:32793_fcbyv%2Fpf-n_0000000000) starting
   [junit4]   2> 6000177 INFO  (zkConnectionManagerCallback-3651-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6000179 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33262/solr ready
   [junit4]   2> 6000205 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32793_fcbyv%2Fpf
   [junit4]   2> 6000221 INFO  (zkCallback-3650-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 6000254 INFO  (zkCallback-3643-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 6001849 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6001882 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6001882 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6001896 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/control-001/cores
   [junit4]   2> 6001985 INFO  (zkConnectionManagerCallback-3656-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6001986 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 6001987 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33262/solr ready
   [junit4]   2> 6002005 INFO  (qtp1084058648-17257) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:32793_fcbyv%252Fpf&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 6002066 INFO  (OverseerThreadFactory-5256-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 6002314 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 6002315 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 6003386 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 6004881 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 6008263 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 6008317 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 6008317 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6008318 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 6008318 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 6008337 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.137067382570807]
   [junit4]   2> 6008375 WARN  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 6010043 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 6010043 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 6010045 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 6010045 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 6010062 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=35.2880859375, floorSegmentMB=1.578125, forceMergeDeletesPctAllowed=16.877844669516435, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5814502245636561
   [junit4]   2> 6010063 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@64cf53b3[control_collection_shard1_replica_n1] main]
   [junit4]   2> 6010064 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 6010065 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6010066 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 6010079 INFO  (searcherExecutor-5259-thread-1-processing-n:127.0.0.1:32793_fcbyv%2Fpf x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@64cf53b3[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 6010079 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599127801201426432
   [junit4]   2> 6010101 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 6010116 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 6010116 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 6010116 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:32793/fcbyv/pf/control_collection_shard1_replica_n1/
   [junit4]   2> 6010116 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 6010116 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:32793/fcbyv/pf/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 6010116 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 6010136 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:32793/fcbyv/pf/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 6010188 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 6010234 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=7919
   [junit4]   2> 6010298 INFO  (qtp1084058648-17257) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 6010351 INFO  (zkCallback-3643-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 6011305 INFO  (qtp1084058648-17257) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:32793_fcbyv%252Fpf&wt=javabin&version=2} status=0 QTime=9300
   [junit4]   2> 6011322 INFO  (zkConnectionManagerCallback-3661-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6011323 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 6011324 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33262/solr ready
   [junit4]   2> 6011324 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 6011324 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 6011343 INFO  (OverseerCollectionConfigSetProcessor-72541544692973572-127.0.0.1:32793_fcbyv%2Fpf-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 6011343 INFO  (OverseerThreadFactory-5256-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 6011344 WARN  (OverseerThreadFactory-5256-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 6011562 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 6011563 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=238
   [junit4]   2> 6012067 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-1-001 of type NRT
   [junit4]   2> 6012068 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 6012098 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 6012098 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 6012098 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 6012098 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@269e69e3{/fcbyv/pf,null,AVAILABLE}
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@722c479a{HTTP/1.1,[http/1.1]}{127.0.0.1:37065}
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server Started @6012296ms
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/fcbyv/pf, hostPort=37065, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-1-001/cores}
   [junit4]   2> 6012099 ERROR (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 6012099 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-04-30T00:11:54.677Z
   [junit4]   2> 6012101 INFO  (zkConnectionManagerCallback-3663-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6012102 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 6012102 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-1-001/solr.xml
   [junit4]   2> 6012122 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 6012122 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 6012123 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 6012136 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33262/solr
   [junit4]   2> 6012174 INFO  (zkConnectionManagerCallback-3667-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6012176 INFO  (zkConnectionManagerCallback-3669-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6012431 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 6012484 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 6012486 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 6012486 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37065_fcbyv%2Fpf
   [junit4]   2> 6012500 INFO  (zkCallback-3643-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 6012500 INFO  (zkCallback-3650-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 6012501 INFO  (zkCallback-3660-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 6012536 INFO  (zkCallback-3668-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 6013352 INFO  (OverseerCollectionConfigSetProcessor-72541544692973572-127.0.0.1:32793_fcbyv%2Fpf-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 6013489 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6013543 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6013543 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6013545 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-1-001/cores
   [junit4]   2> 6013575 INFO  (zkConnectionManagerCallback-3676-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6014934 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 6014935 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33262/solr ready
   [junit4]   2> 6015037 INFO  (qtp1084058648-17259) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37065_fcbyv%252Fpf&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 6015080 INFO  (OverseerThreadFactory-5256-thread-3) [    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:37065_fcbyv%2Fpf for creating new replica
   [junit4]   2> 6015099 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 6016280 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 6016333 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 6021681 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 6021753 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 6021754 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6021754 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 6021754 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 6021770 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.137067382570807]
   [junit4]   2> 6021806 WARN  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 6022010 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 6022010 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 6022011 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 6022011 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 6022024 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=35.2880859375, floorSegmentMB=1.578125, forceMergeDeletesPctAllowed=16.877844669516435, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5814502245636561
   [junit4]   2> 6022025 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@71614afe[collection1_shard2_replica_n41] main]
   [junit4]   2> 6022027 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 6022027 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6022044 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 6022045 INFO  (searcherExecutor-5270-thread-1-processing-n:127.0.0.1:37065_fcbyv%2Fpf x:collection1_shard2_replica_n41 c:collection1 s:shard2) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@71614afe[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 6022050 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599127813753929728
   [junit4]   2> 6022084 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0}, version=0}
   [junit4]   2> 6022086 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 6022086 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 6022086 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37065/fcbyv/pf/collection1_shard2_replica_n41/
   [junit4]   2> 6022087 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 6022087 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:37065/fcbyv/pf/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 6022087 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 6022102 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37065/fcbyv/pf/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 6022162 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 6022164 INFO  (qtp960753734-17309) [n:127.0.0.1:37065_fcbyv%2Fpf c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=7065
   [junit4]   2> 6022192 INFO  (qtp1084058648-17259) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:37065_fcbyv%252Fpf&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=7155
   [junit4]   2> 6022193 INFO  (OverseerCollectionConfigSetProcessor-72541544692973572-127.0.0.1:32793_fcbyv%2Fpf-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 6022303 INFO  (zkCallback-3668-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 6023307 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-2-001 of type NRT
   [junit4]   2> 6023308 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 6023440 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 6023440 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 6023440 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 6023452 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7bdb11b2{/fcbyv/pf,null,AVAILABLE}
   [junit4]   2> 6023452 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4a885f11{HTTP/1.1,[http/1.1]}{127.0.0.1:34765}
   [junit4]   2> 6023453 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server Started @6023650ms
   [junit4]   2> 6023453 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/fcbyv/pf, hostPort=34765, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-2-001/cores}
   [junit4]   2> 6023453 ERROR (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 6023469 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 6023469 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 6023469 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 6023469 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 6023469 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-04-30T00:12:06.047Z
   [junit4]   2> 6023513 INFO  (zkConnectionManagerCallback-3678-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6023557 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 6023558 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-2-001/solr.xml
   [junit4]   2> 6023561 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 6023561 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 6023575 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 6023648 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33262/solr
   [junit4]   2> 6023683 INFO  (zkConnectionManagerCallback-3682-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6023732 INFO  (zkConnectionManagerCallback-3684-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6023740 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 6023774 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 6023793 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 6023793 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34765_fcbyv%2Fpf
   [junit4]   2> 6023809 INFO  (zkCallback-3650-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 6023809 INFO  (zkCallback-3683-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 6023810 INFO  (zkCallback-3643-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 6023810 INFO  (zkCallback-3668-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 6023810 INFO  (zkCallback-3660-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 6023822 INFO  (zkCallback-3675-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 6026383 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6026425 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6026425 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6026426 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-2-001/cores
   [junit4]   2> 6026451 INFO  (zkConnectionManagerCallback-3691-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6026464 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 6026465 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33262/solr ready
   [junit4]   2> 6026610 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34765_fcbyv%252Fpf&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 6026632 INFO  (OverseerThreadFactory-5256-thread-4) [    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:34765_fcbyv%2Fpf for creating new replica
   [junit4]   2> 6026681 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 6026711 INFO  (zkCallback-3668-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 6027771 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 6029707 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
   [junit4]   2> 6032839 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 6032894 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
   [junit4]   2> 6032894 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6032894 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 6032894 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
   [junit4]   2> 6032898 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.137067382570807]
   [junit4]   2> 6032919 WARN  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 6034900 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 6034900 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 6034901 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 6034901 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 6034902 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=35.2880859375, floorSegmentMB=1.578125, forceMergeDeletesPctAllowed=16.877844669516435, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5814502245636561
   [junit4]   2> 6034903 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d09e098[collection1_shard1_replica_n43] main]
   [junit4]   2> 6034922 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 6034923 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6034923 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 6034928 INFO  (searcherExecutor-5281-thread-1-processing-n:127.0.0.1:34765_fcbyv%2Fpf x:collection1_shard1_replica_n43 c:collection1 s:shard1) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@1d09e098[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 6034936 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599127827265880064
   [junit4]   2> 6034962 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node44=0}, version=0}
   [junit4]   2> 6034981 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 6034981 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 6034981 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34765/fcbyv/pf/collection1_shard1_replica_n43/
   [junit4]   2> 6034981 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 6034981 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:34765/fcbyv/pf/collection1_shard1_replica_n43/ has no replicas
   [junit4]   2> 6034981 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 6034984 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34765/fcbyv/pf/collection1_shard1_replica_n43/ shard1
   [junit4]   2> 6034986 INFO  (zkCallback-3668-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 6035035 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 6035071 INFO  (qtp38058578-17344) [n:127.0.0.1:34765_fcbyv%2Fpf c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=8390
   [junit4]   2> 6035102 INFO  (qtp1084058648-17261) [n:127.0.0.1:32793_fcbyv%2Fpf    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:34765_fcbyv%252Fpf&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=8492
   [junit4]   2> 6035137 INFO  (zkCallback-3668-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 6035138 INFO  (zkCallback-3683-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 6035841 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-3-001 of type NRT
   [junit4]   2> 6035874 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 6035932 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 6035932 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 6035932 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 6035934 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45a99135{/fcbyv/pf,null,AVAILABLE}
   [junit4]   2> 6035934 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3ebdd1cf{HTTP/1.1,[http/1.1]}{127.0.0.1:36621}
   [junit4]   2> 6035934 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.e.j.s.Server Started @6036132ms
   [junit4]   2> 6035934 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/fcbyv/pf, hostPort=36621, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-3-001/cores}
   [junit4]   2> 6035935 ERROR (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 6035949 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 6035949 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 6035949 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 6035949 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 6035949 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-04-30T00:12:18.527Z
   [junit4]   2> 6036024 INFO  (zkConnectionManagerCallback-3693-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6036033 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 6036034 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_DECA59E877EE92B-001/shard-3-001/solr.xml
   [junit4]   2> 6036054 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 6036054 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 6036056 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 6036115 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33262/solr
   [junit4]   2> 6036134 INFO  (zkConnectionManagerCallback-3697-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6036163 INFO  (zkConnectionManagerCallback-3699-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 6036180 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:36621_fcbyv%2Fpf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 6036181 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:36621_fcbyv%2Fpf    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 6036183 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:36621_fcbyv%2Fpf    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 6036183 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:36621_fcbyv%2Fpf    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36621_fcbyv%2Fpf
   [junit4]   2> 6036285 INFO  (zkCallback-3683-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036297 INFO  (zkCallback-3660-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036297 INFO  (zkCallback-3643-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036297 INFO  (zkCallback-3675-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036297 INFO  (zkCallback-3698-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036297 INFO  (zkCallback-3650-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036297 INFO  (zkCallback-3690-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036297 INFO  (zkCallback-3668-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 6036886 INFO  (OverseerCollectionConfigSetProcessor-72541544692973572-127.0.0.1:32793_fcbyv%2Fpf-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 6041453 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:36621_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@178403ef
   [junit4]   2> 6041509 INFO  (TEST-BasicDistributedZkTest.test-seed#[DECA59E877EE92B]) [n:127.0.0.1:36621_fcbyv%2Fpf    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') e

[...truncated too long message...]

r-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/api-all-1.0.0-M20.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/bcprov-jdk15on-1.54.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/byte-buddy-1.6.2.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/commons-collections-3.2.2.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/commons-math3-3.6.1.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/ehcache-core-2.4.4.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-common-2.7.4-tests.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-hdfs-2.7.4-tests.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-minikdc-2.7.4.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jersey-core-1.9.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jersey-server-1.9.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-6.1.26.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-sslengine-6.1.26.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-util-6.1.26.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/mina-core-2.0.0-M5.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/mockito-core-2.6.2.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/netty-all-4.0.36.Final.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/objenesis-2.5.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/icu/lucene-analyzers-icu-8.0.0-SNAPSHOT.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/contrib/solr-analysis-extras/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/queryparser/classes/test:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/backward-codecs/classes/test:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/analysis-extras/lib/icu4j-61.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/home/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/usr/local/asfpackages/java/jdk1.8.0_172/lib/tools.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J1-20180429_223142_2404089936498140704486.events @/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J1-20180429_223142_2401544982555575606543.suites -stdin
   [junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1540)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:577: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:59: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build.xml:267: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/common-build.xml:557: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:1568: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:1092: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.

Total time: 725 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-NightlyTests-master #1536 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1545 - Failure

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1545/

3 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.StressHdfsTest.test

Error Message:
Could not find collection:delete_data_dir

Stack Trace:
java.lang.AssertionError: Could not find collection:delete_data_dir
	at __randomizedtesting.SeedInfo.seed([FF64D30B0DF389C0:7730ECD1A30FE438]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:915)
	at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:161)
	at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:105)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
	at __randomizedtesting.SeedInfo.seed([FF64D30B0DF389C0:CCD6FBCF00445377]:0)
	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
	at org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
	at org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
	at org.apache.lucene.store.MockIndexOutputWrapper.copyBytes(MockIndexOutputWrapper.java:165)
	at org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
	at org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4945)
	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4448)
	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4040)
	at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2143)
	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5051)
	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1275)
	at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1245)
	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:159)
	at org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit(TestDocTermOrdsUninvertLimit.java:63)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)


FAILED:  org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([D35F87B81F543DB0:B90438A9461A1D43]:0)
	at org.apache.lucene.analysis.LookaheadTokenFilter.peekToken(LookaheadTokenFilter.java:140)
	at org.apache.lucene.analysis.MockRandomLookaheadTokenFilter.incrementToken(MockRandomLookaheadTokenFilter.java:62)
	at org.apache.lucene.analysis.miscellaneous.ConditionalTokenFilter.incrementToken(ConditionalTokenFilter.java:174)
	at org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:65)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:746)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:657)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:559)
	at org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings(TestRandomChains.java:879)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 3401 lines...]
   [junit4] Suite: org.apache.lucene.analysis.core.TestRandomChains
   [junit4]   2> TEST FAIL: useCharFilter=false text=' | 19936 | 712 | {{start-Class}} | {{Low-importance}} |- | 130 | style='text-ali'
   [junit4]   2> Exception from random analyzer: 
   [junit4]   2> charfilters=
   [junit4]   2>   org.apache.lucene.analysis.charfilter.MappingCharFilter(org.apache.lucene.analysis.charfilter.NormalizeCharMap@926d475, java.io.StringReader@54844012)
   [junit4]   2> tokenizer=
   [junit4]   2>   org.apache.lucene.analysis.th.ThaiTokenizer()
   [junit4]   2> filters=ConditionalTokenFilter: 
   [junit4]   2>   org.apache.lucene.analysis.compound.HyphenationCompoundWordTokenFilter(OneTimeWrapper@18c40462 term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,termFrequency=1, org.apache.lucene.analysis.compound.hyphenation.HyphenationTree@27feee73)ConditionalTokenFilter: 
   [junit4]   2>   org.apache.lucene.analysis.standard.ClassicFilter(OneTimeWrapper@62624f01 term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,termFrequency=1)
   [junit4]   2>   org.apache.lucene.analysis.cjk.CJKWidthFilter(ValidatingTokenFilter@a605079 term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,termFrequency=1)ConditionalTokenFilter: 
   [junit4]   2>   org.apache.lucene.analysis.MockRandomLookaheadTokenFilter(java.util.Random@4e40ab26, OneTimeWrapper@79cbf6ad term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,termFrequency=1)
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestRandomChains -Dtests.method=testRandomChainsWithLargeStrings -Dtests.seed=D35F87B81F543DB0 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=en-GB -Dtests.timezone=Asia/Barnaul -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 67.1s J2 | TestRandomChains.testRandomChainsWithLargeStrings <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D35F87B81F543DB0:B90438A9461A1D43]:0)
   [junit4]    > 	at org.apache.lucene.analysis.LookaheadTokenFilter.peekToken(LookaheadTokenFilter.java:140)
   [junit4]    > 	at org.apache.lucene.analysis.MockRandomLookaheadTokenFilter.incrementToken(MockRandomLookaheadTokenFilter.java:62)
   [junit4]    > 	at org.apache.lucene.analysis.miscellaneous.ConditionalTokenFilter.incrementToken(ConditionalTokenFilter.java:174)
   [junit4]    > 	at org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:65)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:746)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:657)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:559)
   [junit4]    > 	at org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings(TestRandomChains.java:879)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/common/test/J2/temp/lucene.analysis.core.TestRandomChains_D35F87B81F543DB0-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {dummy=BlockTreeOrds(blocksize=128)}, docValues:{}, maxPointsInLeafNode=1220, maxMBSortInHeap=7.617602445814867, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@923a769), locale=en-GB, timezone=Asia/Barnaul
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=148688952,total=310378496
   [junit4]   2> NOTE: All tests run in this JVM: [TestTrimFilterFactory, TestPortugueseStemFilter, TestSerbianNormalizationFilterFactory, TestTrimFilter, TestTeeSinkTokenFilter, TestAllAnalyzersHaveFactories, TestFlagNum, TestFrenchLightStemFilter, TestPersianAnalyzer, TestSynonymFilterFactory, TestSpanishLightStemFilter, TestIndonesianStemFilterFactory, TestSnowballPorterFilterFactory, TestLengthFilterFactory, TestGreekLowerCaseFilterFactory, TestNorwegianMinimalStemFilterFactory, TestRandomChains]
   [junit4] Completed [108/288 (1!)] on J2 in 275.60s, 2 tests, 1 failure <<< FAILURES!

[...truncated 10315 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.StressHdfsTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/init-core-data-001
   [junit4]   2> 1713445 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1713446 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1713446 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1713446 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1713489 WARN  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1713495 WARN  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1713499 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1713513 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_59293_hdfs____mm4jte/webapp
   [junit4]   2> 1713938 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59293
   [junit4]   2> 1714005 WARN  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1714006 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1714032 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_38350_datanode____r8fjzk/webapp
   [junit4]   2> 1714473 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38350
   [junit4]   2> 1714585 WARN  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1714586 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1714600 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_45622_datanode____n23nzw/webapp
   [junit4]   2> 1714665 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost/127.0.0.1:60727) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 1714674 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x5fa4dca7976066: from storage DS-7b4ff0ea-3bd7-4b53-88bd-4e4eae826335 node DatanodeRegistration(127.0.0.1:57116, datanodeUuid=ad9261a9-597d-4d87-8fa9-1f93bf832077, infoPort=52233, infoSecurePort=0, ipcPort=38911, storageInfo=lv=-56;cid=testClusterID;nsid=1452309833;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 1714675 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x5fa4dca7976066: from storage DS-7e9058c8-469b-47b9-aad2-bd49f47dc8fc node DatanodeRegistration(127.0.0.1:57116, datanodeUuid=ad9261a9-597d-4d87-8fa9-1f93bf832077, infoPort=52233, infoSecurePort=0, ipcPort=38911, storageInfo=lv=-56;cid=testClusterID;nsid=1452309833;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 1715090 INFO  (SUITE-StressHdfsTest-seed#[FF64D30B0DF389C0]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45622
   [junit4]   2> 1715187 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost/127.0.0.1:60727) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 1715206 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x5fa4dcc74614e3: from storage DS-bd568f51-ee95-4143-860e-a103d56e6485 node DatanodeRegistration(127.0.0.1:42708, datanodeUuid=e559979c-d783-4bec-8257-bd2068040276, infoPort=47480, infoSecurePort=0, ipcPort=35121, storageInfo=lv=-56;cid=testClusterID;nsid=1452309833;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 1715206 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x5fa4dcc74614e3: from storage DS-cc30a0fd-22ae-4202-acd2-42ddeb88211a node DatanodeRegistration(127.0.0.1:42708, datanodeUuid=e559979c-d783-4bec-8257-bd2068040276, infoPort=47480, infoSecurePort=0, ipcPort=35121, storageInfo=lv=-56;cid=testClusterID;nsid=1452309833;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 1715257 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1715259 INFO  (Thread-6952) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1715259 INFO  (Thread-6952) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1715261 ERROR (Thread-6952) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1715358 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.ZkTestServer start zk server on port:51012
   [junit4]   2> 1715366 INFO  (zkConnectionManagerCallback-2101-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1715368 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10644a3d3890000, likely client has closed socket
   [junit4]   2> 1715375 INFO  (zkConnectionManagerCallback-2103-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1715380 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1715382 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1715383 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1715384 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1715386 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1715387 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1715388 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1715389 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1715390 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1715392 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1715393 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1715395 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 1715533 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1715534 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1715534 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1715534 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1715534 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@42cb3998{/,null,AVAILABLE}
   [junit4]   2> 1715534 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@48f4311f{HTTP/1.1,[http/1.1]}{127.0.0.1:54908}
   [junit4]   2> 1715534 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.Server Started @1715610ms
   [junit4]   2> 1715534 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:60727/hdfs__localhost_60727__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-master_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001_tempDir-002_control_data, hostContext=/, hostPort=54908, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/control-001/cores}
   [junit4]   2> 1715535 ERROR (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1715535 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1715535 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1715535 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1715535 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1715535 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T18:51:34.219Z
   [junit4]   2> 1715543 INFO  (zkConnectionManagerCallback-2105-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1715544 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10644a3d3890002, likely client has closed socket
   [junit4]   2> 1715544 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1715544 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/control-001/solr.xml
   [junit4]   2> 1715549 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1715549 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1715550 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1715555 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51012/solr
   [junit4]   2> 1715556 INFO  (zkConnectionManagerCallback-2109-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1715559 INFO  (zkConnectionManagerCallback-2111-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1715662 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1715663 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54908_
   [junit4]   2> 1715664 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.c.Overseer Overseer (id=73821914317520900-127.0.0.1:54908_-n_0000000000) starting
   [junit4]   2> 1715678 INFO  (zkConnectionManagerCallback-2118-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1715680 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51012/solr ready
   [junit4]   2> 1715684 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54908_
   [junit4]   2> 1715691 INFO  (OverseerStateUpdate-73821914317520900-127.0.0.1:54908_-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1715699 INFO  (zkCallback-2117-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1715917 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1715918 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1715918 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1715920 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:54908_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/control-001/cores
   [junit4]   2> 1715952 INFO  (zkConnectionManagerCallback-2123-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1715953 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1715954 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51012/solr ready
   [junit4]   2> 1715956 INFO  (qtp739462905-13993) [n:127.0.0.1:54908_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54908_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1715965 INFO  (OverseerThreadFactory-3493-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 1716075 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_    x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1716075 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_    x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1717108 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1717126 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1717290 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1717309 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 1717310 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1717310 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:60727/solr_hdfs_home
   [junit4]   2> 1717310 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1717310 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1717310 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[hdfs://localhost:60727/solr_hdfs_home/control_collection/core_node2/data/]
   [junit4]   2> 1717312 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/control_collection/core_node2/data/snapshot_metadata
   [junit4]   2> 1717320 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 1717321 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1717321 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1717332 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1717333 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/control_collection/core_node2/data
   [junit4]   2> 1717361 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/control_collection/core_node2/data/index
   [junit4]   2> 1717369 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 1717370 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1717370 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1717378 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1717378 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@fc2800e
   [junit4]   2> 1717409 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57116 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-cc30a0fd-22ae-4202-acd2-42ddeb88211a:NORMAL:127.0.0.1:42708|RBW], ReplicaUC[[DISK]DS-7b4ff0ea-3bd7-4b53-88bd-4e4eae826335:NORMAL:127.0.0.1:57116|FINALIZED]]} size 0
   [junit4]   2> 1717412 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42708 is added to blk_1073741825_1001 size 69
   [junit4]   2> 1717418 WARN  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1717480 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1717481 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1717481 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 1717492 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1717492 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1717499 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8713074921283205]
   [junit4]   2> 1717531 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@51dc681b[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1717533 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1717533 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1717534 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1717534 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600828993666285568
   [junit4]   2> 1717538 INFO  (searcherExecutor-3496-thread-1-processing-n:127.0.0.1:54908_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@51dc681b[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1717554 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 1717558 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1717558 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1717558 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54908/control_collection_shard1_replica_n1/
   [junit4]   2> 1717558 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1717558 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:54908/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1717558 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1717563 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54908/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1717667 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1717670 INFO  (qtp739462905-13988) [n:127.0.0.1:54908_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1595
   [junit4]   2> 1717675 INFO  (qtp739462905-13993) [n:127.0.0.1:54908_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1717770 INFO  (zkCallback-2110-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1717969 INFO  (OverseerCollectionConfigSetProcessor-73821914317520900-127.0.0.1:54908_-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1718675 INFO  (qtp739462905-13993) [n:127.0.0.1:54908_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54908_&wt=javabin&version=2} status=0 QTime=2718
   [junit4]   2> 1718688 INFO  (zkConnectionManagerCallback-2128-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1718689 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1718690 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51012/solr ready
   [junit4]   2> 1718690 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1718692 INFO  (qtp739462905-13989) [n:127.0.0.1:54908_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1718695 INFO  (OverseerThreadFactory-3493-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1718696 WARN  (OverseerThreadFactory-3493-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 1718902 INFO  (qtp739462905-13989) [n:127.0.0.1:54908_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1718902 INFO  (qtp739462905-13989) [n:127.0.0.1:54908_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=210
   [junit4]   2> 1718915 INFO  (OverseerCollectionConfigSetProcessor-73821914317520900-127.0.0.1:54908_-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1719059 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-1-001 of type TLOG
   [junit4]   2> 1719060 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1719060 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1719061 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1719061 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1719061 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ca23661{/,null,AVAILABLE}
   [junit4]   2> 1719061 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@16eac584{HTTP/1.1,[http/1.1]}{127.0.0.1:53147}
   [junit4]   2> 1719061 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.Server Started @1719137ms
   [junit4]   2> 1719061 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:60727/hdfs__localhost_60727__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-master_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001_tempDir-002_jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=53147, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-1-001/cores}
   [junit4]   2> 1719062 ERROR (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1719062 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1719062 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1719062 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1719062 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1719062 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T18:51:37.746Z
   [junit4]   2> 1719073 INFO  (zkConnectionManagerCallback-2130-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1719074 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1719074 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-1-001/solr.xml
   [junit4]   2> 1719078 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1719078 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1719079 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1719084 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51012/solr
   [junit4]   2> 1719086 INFO  (zkConnectionManagerCallback-2134-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1719088 INFO  (zkConnectionManagerCallback-2136-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1719095 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1719097 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1719100 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1719100 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53147_
   [junit4]   2> 1719101 INFO  (zkCallback-2117-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1719101 INFO  (zkCallback-2110-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1719116 INFO  (zkCallback-2135-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1719125 INFO  (zkCallback-2127-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1719397 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1719411 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1719412 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1719414 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-1-001/cores
   [junit4]   2> 1719418 INFO  (zkConnectionManagerCallback-2143-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1719419 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1719421 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:53147_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51012/solr ready
   [junit4]   2> 1719467 INFO  (qtp1247682841-14055) [n:127.0.0.1:53147_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53147_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1719475 INFO  (OverseerThreadFactory-3493-thread-3) [ c:collection1 s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:53147_ for creating new replica
   [junit4]   2> 1719479 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_    x:collection1_shard1_replica_t21] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1720507 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1720523 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema [collection1_shard1_replica_t21] Schema name=test
   [junit4]   2> 1720674 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1720692 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t21' using configuration from collection collection1, trusted=true
   [junit4]   2> 1720692 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t21' (registry 'solr.core.collection1.shard1.replica_t21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1720692 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:60727/solr_hdfs_home
   [junit4]   2> 1720692 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1720692 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1720692 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [[collection1_shard1_replica_t21] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-1-001/cores/collection1_shard1_replica_t21], dataDir=[hdfs://localhost:60727/solr_hdfs_home/collection1/core_node22/data/]
   [junit4]   2> 1720694 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/collection1/core_node22/data/snapshot_metadata
   [junit4]   2> 1720703 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 1720703 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1720703 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1720711 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1720712 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/collection1/core_node22/data
   [junit4]   2> 1720733 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/collection1/core_node22/data/index
   [junit4]   2> 1720742 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 1720742 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1720742 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1720756 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1720757 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2088fc27
   [junit4]   2> 1720771 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57116 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-bd568f51-ee95-4143-860e-a103d56e6485:NORMAL:127.0.0.1:42708|RBW], ReplicaUC[[DISK]DS-7e9058c8-469b-47b9-aad2-bd49f47dc8fc:NORMAL:127.0.0.1:57116|RBW]]} size 0
   [junit4]   2> 1720773 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42708 is added to blk_1073741826_1002 size 69
   [junit4]   2> 1720779 WARN  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1720852 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1720852 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1720852 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 1720864 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1720864 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1720867 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8713074921283205]
   [junit4]   2> 1720872 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.SolrIndexSearcher Opening [Searcher@129698b5[collection1_shard1_replica_t21] main]
   [junit4]   2> 1720874 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1720875 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1720876 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1720877 INFO  (searcherExecutor-3507-thread-1-processing-n:127.0.0.1:53147_ x:collection1_shard1_replica_t21 c:collection1 s:shard1) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [collection1_shard1_replica_t21] Registered new searcher Searcher@129698b5[collection1_shard1_replica_t21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1720877 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600828997171675136
   [junit4]   2> 1720885 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node22=0}, version=0}
   [junit4]   2> 1720888 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1720888 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1720889 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53147/collection1_shard1_replica_t21/
   [junit4]   2> 1720889 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1720889 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy http://127.0.0.1:53147/collection1_shard1_replica_t21/ has no replicas
   [junit4]   2> 1720889 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1720889 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ZkController collection1_shard1_replica_t21 stopping background replication from leader
   [junit4]   2> 1720893 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53147/collection1_shard1_replica_t21/ shard1
   [junit4]   2> 1720995 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1720997 INFO  (qtp1247682841-14050) [n:127.0.0.1:53147_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1518
   [junit4]   2> 1721000 INFO  (qtp1247682841-14055) [n:127.0.0.1:53147_ c:collection1   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:53147_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1533
   [junit4]   2> 1721098 INFO  (zkCallback-2135-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1721145 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-2-001 of type TLOG
   [junit4]   2> 1721146 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1721147 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1721147 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1721147 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1721148 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ab482ed{/,null,AVAILABLE}
   [junit4]   2> 1721148 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@731dc908{HTTP/1.1,[http/1.1]}{127.0.0.1:46350}
   [junit4]   2> 1721149 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.e.j.s.Server Started @1721225ms
   [junit4]   2> 1721149 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:60727/hdfs__localhost_60727__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-master_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001_tempDir-002_jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=46350, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-2-001/cores}
   [junit4]   2> 1721149 ERROR (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1721150 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1721150 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1721150 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1721150 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1721150 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-18T18:51:39.834Z
   [junit4]   2> 1721152 INFO  (zkConnectionManagerCallback-2145-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1721153 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1721153 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-2-001/solr.xml
   [junit4]   2> 1721157 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1721157 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1721173 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1721178 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51012/solr
   [junit4]   2> 1721180 INFO  (zkConnectionManagerCallback-2149-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1721182 INFO  (zkConnectionManagerCallback-2151-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1721189 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1721192 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1721200 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1721200 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46350_
   [junit4]   2> 1721202 INFO  (zkCallback-2135-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1721204 INFO  (zkCallback-2117-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1721217 INFO  (zkCallback-2127-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1721227 INFO  (zkCallback-2110-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1721235 INFO  (zkCallback-2142-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1721236 INFO  (zkCallback-2150-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1721313 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1721328 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1721328 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1721330 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-2-001/cores
   [junit4]   2> 1721334 INFO  (zkConnectionManagerCallback-2158-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1721335 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1721336 INFO  (TEST-StressHdfsTest.test-seed#[FF64D30B0DF389C0]) [n:127.0.0.1:46350_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51012/solr ready
   [junit4]   2> 1721382 INFO  (qtp350443907-14097) [n:127.0.0.1:46350_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46350_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1721384 INFO  (OverseerCollectionConfigSetProcessor-73821914317520900-127.0.0.1:54908_-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1721386 INFO  (OverseerThreadFactory-3493-thread-4) [ c:collection1 s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:46350_ for creating new replica
   [junit4]   2> 1721391 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_    x:collection1_shard1_replica_t23] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1721497 INFO  (zkCallback-2135-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1722412 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1722428 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.IndexSchema [collection1_shard1_replica_t23] Schema name=test
   [junit4]   2> 1722578 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1722595 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t23' using configuration from collection collection1, trusted=true
   [junit4]   2> 1722596 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t23' (registry 'solr.core.collection1.shard1.replica_t23') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@363b0fa2
   [junit4]   2> 1722596 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:60727/solr_hdfs_home
   [junit4]   2> 1722596 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1722596 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1722596 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.SolrCore [[collection1_shard1_replica_t23] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_FF64D30B0DF389C0-001/shard-2-001/cores/collection1_shard1_replica_t23], dataDir=[hdfs://localhost:60727/solr_hdfs_home/collection1/core_node24/data/]
   [junit4]   2> 1722598 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/collection1/core_node24/data/snapshot_metadata
   [junit4]   2> 1722606 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 1722607 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1722607 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1722615 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1722616 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/collection1/core_node24/data
   [junit4]   2> 1722634 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:60727/solr_hdfs_home/collection1/core_node24/data/index
   [junit4]   2> 1722642 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 1722642 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1722642 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1722651 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1722651 INFO  (qtp350443907-14093) [n:127.0.0.1:46350_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6677ea84
   [junit4]   2> 1722666 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57116 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-bd568f51-ee95-4143-860e-a103d56e6485:NORMAL:127.0.0.1:42708|RBW], ReplicaUC[[DISK]DS-7b4ff0ea-3bd7-4b53-88bd-4e4eae826335:NORMAL:127.0.0.1:57116|RBW]]} size 0
   [junit4]   2> 1722667 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42708 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-bd568f51-ee95-4143-860e-a103d56e6485:NORMAL:127.0.0.1:42708|RBW], ReplicaUC[[DISK]DS-7b4ff0ea-3bd7-4b53-88bd-4e4eae826335:NORMAL:127.0.0.1:57116|RBW]]} size 0
   [junit4]   2> 1722668 WARN  (DataStreamer for file /solr_hdfs_home/collection1/core_node24/data/index/pending_segments_1) [    ] o.a.h.h.DFSClient Caught exception 
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.lang.Object.wait(Native Method) ~[?:1.8.0_172]
   [junit4]   2> 	at java.lang.Thread.join(Thread.java:1252) ~[?:1.8.0_172]
   [junit4]   2> 	at java.lang.Thread.join(Thread.java:1326) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:716) [hadoop-hdfs-2.7.4.jar:?]
   [junit4]   2> 	at org.apache.hadoop

[...truncated too long message...]

UninvertLimit.testTriggerUnInvertLimit <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FF64D30B0DF389C0:CCD6FBCF00445377]:0)
   [junit4]    > 	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
   [junit4]    > 	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
   [junit4]    > 	at org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]    > 	at org.apache.lucene.store.MockIndexOutputWrapper.copyBytes(MockIndexOutputWrapper.java:165)
   [junit4]    > 	at org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4945)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4448)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4040)
   [junit4]    > 	at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2143)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5051)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1275)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1245)
   [junit4]    > 	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:159)
   [junit4]    > 	at org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit(TestDocTermOrdsUninvertLimit.java:63)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {field=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{}, maxPointsInLeafNode=864, maxMBSortInHeap=7.219354072554283, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@467995ba), locale=es-PE, timezone=US/Michigan
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=150605400,total=477626368
   [junit4]   2> NOTE: All tests run in this JVM: [SampleTest, TestSSLRandomization, SolrInfoBeanTest, RestoreTriggerStateTest, TestReplicationHandler, LeaderElectionContextKeyTest, CoreAdminRequestStatusTest, MissingSegmentRecoveryTest, MetricTriggerTest, HdfsDirectoryTest, TestConfigSets, DistributedQueueTest, TestSimpleTrackingShardHandler, TestUseDocValuesAsStored2, SolrMetricsIntegrationTest, RecoveryAfterSoftCommitTest, SyncSliceTest, CdcrRequestHandlerTest, TestComplexPhraseQParserPlugin, TestSizeLimitedDistributedMap, ResourceLoaderTest, TestHttpShardHandlerFactory, ParsingFieldUpdateProcessorsTest, NodeLostTriggerIntegrationTest, TestHalfAndHalfDocValues, DirectSolrConnectionTest, TestBulkSchemaAPI, SolrXmlInZkTest, SubstringBytesRefFilterTest, TestSolrCoreSnapshots, BooleanFieldTest, TestGeoJSONResponseWriter, TestDynamicFieldResource, TestReload, DOMUtilTest, TestStressRecovery, TestRandomRequestDistribution, TestLegacyNumericUtils, TestSQLHandlerNonCloud, TestSolrIndexConfig, IndexSchemaTest, PeerSyncTest, TolerantUpdateProcessorTest, CollectionsAPISolrJTest, TestSolr4Spatial, TestJsonFacetRefinement, TriggerIntegrationTest, TestFileDictionaryLookup, DocExpirationUpdateProcessorFactoryTest, HighlighterTest, TemplateUpdateProcessorTest, TestInPlaceUpdatesDistrib, TestDocBasedVersionConstraints, TestManagedSchemaThreadSafety, TestXmlQParser, TestOverriddenPrefixQueryForCustomFieldType, TestRecovery, NodeMutatorTest, AssignBackwardCompatibilityTest, SolrCloudReportersTest, DeleteInactiveReplicaTest, TestReloadAndDeleteDocs, SolrJmxReporterCloudTest, HttpSolrCallGetCoreTest, SearchHandlerTest, TestSearchPerf, LoggingHandlerTest, MetricsHandlerTest, TestDownShardTolerantSearch, UpdateRequestProcessorFactoryTest, FileUtilsTest, SchemaVersionSpecificBehaviorTest, TestCloudManagedSchema, TestSweetSpotSimilarityFactory, SliceStateTest, TestRuleBasedAuthorizationPlugin, RuleEngineTest, TestFoldingMultitermQuery, TestSlowCompositeReaderWrapper, ForceLeaderTest, SoftAutoCommitTest, TestTolerantUpdateProcessorCloud, TestLeaderElectionZkExpiry, TestImpersonationWithHadoopAuth, HttpTriggerListenerTest, XsltUpdateRequestHandlerTest, TestNestedDocsSort, SolrCoreMetricManagerTest, TestCloudDeleteByQuery, TestFilteredDocIdSet, TestLocalFSCloudBackupRestore, TestMinMaxOnMultiValuedField, DistribCursorPagingTest, TestPostingsSolrHighlighter, TestInfoStreamLogging, TestReversedWildcardFilterFactory, TestManagedSynonymFilterFactory, ClassificationUpdateProcessorIntegrationTest, UtilsToolTest, CustomHighlightComponentTest, PolyFieldTest, ActionThrottleTest, TestManagedResource, TestPartialUpdateDeduplication, TestReRankQParserPlugin, HdfsThreadLeakTest, SpellCheckCollatorWithCollapseTest, SegmentsInfoRequestHandlerTest, HttpPartitionTest, TestLRUStatsCache, TestClassicSimilarityFactory, SimplePostToolTest, ReplaceNodeTest, AtomicUpdateProcessorFactoryTest, TestInitQParser, TestSolrConfigHandler, TestNumericRangeQuery32, TestConfigSetsAPIExclusivity, TestSystemIdResolver, TestSerializedLuceneMatchVersion, LeaderVoteWaitTimeoutTest, TestPushWriter, CSVRequestHandlerTest, TestCollectionAPIs, HdfsBasicDistributedZk2Test, HdfsDirectoryFactoryTest, FastVectorHighlighterTest, TlogReplayBufferedWhileIndexingTest, TestEmbeddedSolrServerSchemaAPI, TestZkChroot, TestSolr4Spatial2, HdfsRecoveryZkTest, CdcrBootstrapTest, ChaosMonkeySafeLeaderTest, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest, ClusterStateUpdateTest, TestRandomFaceting, ZkSolrClientTest, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, TestDistributedGrouping, TestFaceting, DistributedSpellCheckComponentTest, ZkControllerTest, TestJoin, TestStressVersions, TestRangeQuery, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestPhraseSuggestions, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TimeZoneUtilsTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, PrimUtilsTest, DateFieldTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest, CircularListTest, DistributedMLTComponentTest, DistributedIntervalFacetingTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CreateCollectionCleanupTest, DeleteReplicaTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, LegacyCloudClusterPropTest, MoveReplicaHDFSFailoverTest, MoveReplicaTest, MultiThreadedOCPTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerStatusTest, OverseerTaskQueueTest, SSLMigrationTest, SaslZkACLProviderTest, TestCloudPseudoReturnFields, TestCloudRecovery, TestConfigSetsAPI, TestOnReconnectListenerSupport, TestPrepRecovery, TestPullReplica, TestRebalanceLeaders, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestStressInPlaceUpdates, TestTolerantUpdateProcessorRandomCloud, TriLevelCompositeIdRoutingTest, ZkShardTermsTest, AssignTest, CollectionsAPIAsyncDistributedZkTest, CustomCollectionTest, HdfsCollectionsAPIDistributedZkTest, TestRequestStatusCollectionAPI, ExecutePlanActionTest, NodeMarkersRegistrationTest, SystemLogListenerTest, TriggerCooldownIntegrationTest, TriggerSetPropertiesIntegrationTest, TestClusterStateProvider, TestComputePlanAction, TestDistribStateManager, TestExecutePlanAction, TestGenericDistributedQueue, TestLargeCluster, TestNodeAddedTrigger, TestNodeLostTrigger, TestPolicyCloud, TestTriggerIntegration, BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest, CdcrVersionReplicationTest, HDFSCollectionsAPITest, HdfsBasicDistributedZkTest, TestExactSharedStatsCache, PKIAuthenticationIntegrationTest, TestSolrCloudWithHadoopAuthPlugin, TestBlendedInfixSuggestions, BufferStoreTest, TestDocTermOrdsUninvertLimit]
   [junit4] Completed [779/806 (2!)] on J1 in 73.63s, 1 test, 1 error <<< FAILURES!

[...truncated 76 lines...]
   [junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J1-20180518_182258_5274020119577349881658.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid30670.hprof ...
   [junit4] Heap dump file created [475314518 bytes in 2.223 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 9427 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:585: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid30670.hprof

Total time: 418 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1544 - Still unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1544/

4 tests failed.
FAILED:  org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates

Error Message:
_1_q.fnm

Stack Trace:
java.io.FileNotFoundException: _1_q.fnm
	at __randomizedtesting.SeedInfo.seed([4753723B75C963B3:3F76AC3097E94C51]:0)
	at org.apache.lucene.store.RAMDirectory.openInput(RAMDirectory.java:243)
	at org.apache.lucene.store.Directory.openChecksumInput(Directory.java:121)
	at org.apache.lucene.store.RawDirectoryWrapper.openChecksumInput(RawDirectoryWrapper.java:41)
	at org.apache.lucene.codecs.lucene60.Lucene60FieldInfosFormat.read(Lucene60FieldInfosFormat.java:113)
	at org.apache.lucene.index.SegmentReader.initFieldInfos(SegmentReader.java:190)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:93)
	at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:559)
	at org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:606)
	at org.apache.lucene.index.FrozenBufferedUpdates.apply(FrozenBufferedUpdates.java:299)
	at org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2575)
	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5047)
	at org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1758)
	at org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates(TestBinaryDocValuesUpdates.java:1323)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.lucene.index.TestMixedDocValuesUpdates.testTonsOfUpdates

Error Message:
_1_s.fnm

Stack Trace:
java.io.FileNotFoundException: _1_s.fnm
	at __randomizedtesting.SeedInfo.seed([4753723B75C963B3:3F76AC3097E94C51]:0)
	at org.apache.lucene.store.RAMDirectory.openInput(RAMDirectory.java:243)
	at org.apache.lucene.store.Directory.openChecksumInput(Directory.java:121)
	at org.apache.lucene.store.RawDirectoryWrapper.openChecksumInput(RawDirectoryWrapper.java:41)
	at org.apache.lucene.codecs.lucene60.Lucene60FieldInfosFormat.read(Lucene60FieldInfosFormat.java:113)
	at org.apache.lucene.index.SegmentReader.initFieldInfos(SegmentReader.java:190)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:93)
	at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:559)
	at org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:606)
	at org.apache.lucene.index.FrozenBufferedUpdates.apply(FrozenBufferedUpdates.java:299)
	at org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2575)
	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5047)
	at org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1758)
	at org.apache.lucene.index.TestMixedDocValuesUpdates.testTonsOfUpdates(TestMixedDocValuesUpdates.java:390)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration

Error Message:
events: [CapturedEvent{timestamp=26946877293409193, stage=STARTED, actionName='null', event={   "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",   "source":"index_size_trigger2",   "eventTime":26946871051945343,   "eventType":"INDEXSIZE",   "properties":{     "__start__":1,     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946877218366043,     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946878527898143, stage=BEFORE_ACTION, actionName='compute_plan', event={   "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",   "source":"index_size_trigger2",   "eventTime":26946871051945343,   "eventType":"INDEXSIZE",   "properties":{     "__start__":1,     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946877218366043,     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946878739520843, stage=AFTER_ACTION, actionName='compute_plan', event={   "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",   "source":"index_size_trigger2",   "eventTime":26946871051945343,   "eventType":"INDEXSIZE",   "properties":{     "__start__":1,     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946877218366043,     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946878760727893, stage=BEFORE_ACTION, actionName='execute_plan', event={   "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",   "source":"index_size_trigger2",   "eventTime":26946871051945343,   "eventType":"INDEXSIZE",   "properties":{     "__start__":1,     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946877218366043,     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946886287681243, stage=AFTER_ACTION, actionName='execute_plan', event={   "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",   "source":"index_size_trigger2",   "eventTime":26946871051945343,   "eventType":"INDEXSIZE",   "properties":{     "__start__":1,     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946877218366043,     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger2/5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger2/5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j/0] in completed tasks},success=}], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946886315304043, stage=SUCCEEDED, actionName='null', event={   "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",   "source":"index_size_trigger2",   "eventTime":26946871051945343,   "eventType":"INDEXSIZE",   "properties":{     "__start__":1,     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946877218366043,     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897635414543, stage=STARTED, actionName='null', event={   "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",   "source":"index_size_trigger2",   "eventTime":26946891450011043,   "eventType":"INDEXSIZE",   "properties":{     "__start__":3,     "aboveSize":{"testSplitIntegration_collection":[         "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946897619754493,     "requestedOps":[       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897753560293, stage=BEFORE_ACTION, actionName='compute_plan', event={   "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",   "source":"index_size_trigger2",   "eventTime":26946891450011043,   "eventType":"INDEXSIZE",   "properties":{     "__start__":3,     "aboveSize":{"testSplitIntegration_collection":[         "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946897619754493,     "requestedOps":[       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897842670943, stage=AFTER_ACTION, actionName='compute_plan', event={   "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",   "source":"index_size_trigger2",   "eventTime":26946891450011043,   "eventType":"INDEXSIZE",   "properties":{     "__start__":3,     "aboveSize":{"testSplitIntegration_collection":[         "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946897619754493,     "requestedOps":[       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_0}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897873837143, stage=BEFORE_ACTION, actionName='execute_plan', event={   "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",   "source":"index_size_trigger2",   "eventTime":26946891450011043,   "eventType":"INDEXSIZE",   "properties":{     "__start__":3,     "aboveSize":{"testSplitIntegration_collection":[         "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",         "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},     "belowSize":{},     "_enqueue_time_":26946897619754493,     "requestedOps":[       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",       "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_0}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={   "trigger":"index_size_trigger2",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "afterAction":[     "compute_plan",     "execute_plan"],   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",   "beforeAction":[     "compute_plan",     "execute_plan"]}, message='null'}] expected:<6> but was:<10>

Stack Trace:
java.lang.AssertionError: events: [CapturedEvent{timestamp=26946877293409193, stage=STARTED, actionName='null', event={
  "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",
  "source":"index_size_trigger2",
  "eventTime":26946871051945343,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":1,
    "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946877218366043,
    "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946878527898143, stage=BEFORE_ACTION, actionName='compute_plan', event={
  "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",
  "source":"index_size_trigger2",
  "eventTime":26946871051945343,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":1,
    "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946877218366043,
    "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946878739520843, stage=AFTER_ACTION, actionName='compute_plan', event={
  "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",
  "source":"index_size_trigger2",
  "eventTime":26946871051945343,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":1,
    "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946877218366043,
    "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946878760727893, stage=BEFORE_ACTION, actionName='execute_plan', event={
  "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",
  "source":"index_size_trigger2",
  "eventTime":26946871051945343,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":1,
    "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946877218366043,
    "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946886287681243, stage=AFTER_ACTION, actionName='execute_plan', event={
  "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",
  "source":"index_size_trigger2",
  "eventTime":26946871051945343,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":1,
    "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946877218366043,
    "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger2/5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger2/5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j/0] in completed tasks},success=}], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946886315304043, stage=SUCCEEDED, actionName='null', event={
  "id":"5fbc0954dc057fT77wm1x5scs4htzysv9l5tkh9j",
  "source":"index_size_trigger2",
  "eventTime":26946871051945343,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":1,
    "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946877218366043,
    "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897635414543, stage=STARTED, actionName='null', event={
  "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",
  "source":"index_size_trigger2",
  "eventTime":26946891450011043,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":3,
    "aboveSize":{"testSplitIntegration_collection":[
        "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946897619754493,
    "requestedOps":[
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897753560293, stage=BEFORE_ACTION, actionName='compute_plan', event={
  "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",
  "source":"index_size_trigger2",
  "eventTime":26946891450011043,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":3,
    "aboveSize":{"testSplitIntegration_collection":[
        "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946897619754493,
    "requestedOps":[
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897842670943, stage=AFTER_ACTION, actionName='compute_plan', event={
  "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",
  "source":"index_size_trigger2",
  "eventTime":26946891450011043,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":3,
    "aboveSize":{"testSplitIntegration_collection":[
        "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946897619754493,
    "requestedOps":[
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_0}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}, CapturedEvent{timestamp=26946897873837143, stage=BEFORE_ACTION, actionName='execute_plan', event={
  "id":"5fbc0e14adcda3T77wm1x5scs4htzysv9l5tkh9m",
  "source":"index_size_trigger2",
  "eventTime":26946891450011043,
  "eventType":"INDEXSIZE",
  "properties":{
    "__start__":3,
    "aboveSize":{"testSplitIntegration_collection":[
        "{\"core_node10\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":12,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":12,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10002_solr\",\n    \"base_url\":\"http://127.0.0.1:10002/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":12,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_1_replica1\",\n    \"shard\":\"shard1_1\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node3\":{\n    \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":25,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":25,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":25,\n    \"__bytes__\":1,\n    \"shard\":\"shard2\",\n    \"collection\":\"testSplitIntegration_collection\"}}",
        "{\"core_node7\":{\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":13,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":13,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"base_url\":\"http://127.0.0.1:10001/solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":13,\n    \"__bytes__\":1,\n    \"core\":\"testSplitIntegration_collection_shard1_0_replica0\",\n    \"shard\":\"shard1_0\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
    "belowSize":{},
    "_enqueue_time_":26946897619754493,
    "requestedOps":[
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_1\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard2\"}]}}",
      "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1_0}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={
  "trigger":"index_size_trigger2",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "afterAction":[
    "compute_plan",
    "execute_plan"],
  "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
  "beforeAction":[
    "compute_plan",
    "execute_plan"]}, message='null'}] expected:<6> but was:<10>
	at __randomizedtesting.SeedInfo.seed([D66C2ADD4867CC79:EFE2939D67980587]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:314)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([D66C2ADD4867CC79:B5A71C5FD1A8BF54]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger(SearchRateTriggerTest.java:133)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 475 lines...]
   [junit4] Suite: org.apache.lucene.index.TestMixedDocValuesUpdates
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMixedDocValuesUpdates -Dtests.method=testTonsOfUpdates -Dtests.seed=4753723B75C963B3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=de -Dtests.timezone=America/Argentina/Ushuaia -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   36.4s J2 | TestMixedDocValuesUpdates.testTonsOfUpdates <<<
   [junit4]    > Throwable #1: java.io.FileNotFoundException: _1_s.fnm
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4753723B75C963B3:3F76AC3097E94C51]:0)
   [junit4]    > 	at org.apache.lucene.store.RAMDirectory.openInput(RAMDirectory.java:243)
   [junit4]    > 	at org.apache.lucene.store.Directory.openChecksumInput(Directory.java:121)
   [junit4]    > 	at org.apache.lucene.store.RawDirectoryWrapper.openChecksumInput(RawDirectoryWrapper.java:41)
   [junit4]    > 	at org.apache.lucene.codecs.lucene60.Lucene60FieldInfosFormat.read(Lucene60FieldInfosFormat.java:113)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.initFieldInfos(SegmentReader.java:190)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:93)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:559)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:606)
   [junit4]    > 	at org.apache.lucene.index.FrozenBufferedUpdates.apply(FrozenBufferedUpdates.java:299)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2575)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5047)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1758)
   [junit4]    > 	at org.apache.lucene.index.TestMixedDocValuesUpdates.testTonsOfUpdates(TestMixedDocValuesUpdates.java:390)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/J2/temp/lucene.index.TestMixedDocValuesUpdates_4753723B75C963B3-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@171ff165), locale=de, timezone=America/Argentina/Ushuaia
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=198966552,total=400556032
   [junit4]   2> NOTE: All tests run in this JVM: [TestByteArrayDataInput, TestQueryRescorer, TestBufferedIndexInput, TestNamedSPILoader, TestHighCompressionMode, TestFilterCodecReader, TestDateTools, TestLucene50TermVectorsFormat, TestStressAdvance, TestLMDirichletSimilarity, TestIndexingSequenceNumbers, TestMixedDocValuesUpdates]
   [junit4] Completed [69/495 (1!)] on J2 in 71.07s, 10 tests, 1 error <<< FAILURES!

[...truncated 1179 lines...]
   [junit4] Suite: org.apache.lucene.index.TestBinaryDocValuesUpdates
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBinaryDocValuesUpdates -Dtests.method=testTonsOfUpdates -Dtests.seed=4753723B75C963B3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=fr-CA -Dtests.timezone=America/Thule -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   24.5s J2 | TestBinaryDocValuesUpdates.testTonsOfUpdates <<<
   [junit4]    > Throwable #1: java.io.FileNotFoundException: _1_q.fnm
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4753723B75C963B3:3F76AC3097E94C51]:0)
   [junit4]    > 	at org.apache.lucene.store.RAMDirectory.openInput(RAMDirectory.java:243)
   [junit4]    > 	at org.apache.lucene.store.Directory.openChecksumInput(Directory.java:121)
   [junit4]    > 	at org.apache.lucene.store.RawDirectoryWrapper.openChecksumInput(RawDirectoryWrapper.java:41)
   [junit4]    > 	at org.apache.lucene.codecs.lucene60.Lucene60FieldInfosFormat.read(Lucene60FieldInfosFormat.java:113)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.initFieldInfos(SegmentReader.java:190)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:93)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:559)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:606)
   [junit4]    > 	at org.apache.lucene.index.FrozenBufferedUpdates.apply(FrozenBufferedUpdates.java:299)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2575)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5047)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1758)
   [junit4]    > 	at org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates(TestBinaryDocValuesUpdates.java:1323)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   1> TEST: isNRT=false reader1=StandardDirectoryReader(segments_1:4 _0(8.0.0):C2)
   [junit4]   1> TEST: now reopen
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/J2/temp/lucene.index.TestBinaryDocValuesUpdates_4753723B75C963B3-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@49c17141), locale=fr-CA, timezone=America/Thule
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=171529296,total=455606272
   [junit4]   2> NOTE: All tests run in this JVM: [TestByteArrayDataInput, TestQueryRescorer, TestBufferedIndexInput, TestNamedSPILoader, TestHighCompressionMode, TestFilterCodecReader, TestDateTools, TestLucene50TermVectorsFormat, TestStressAdvance, TestLMDirichletSimilarity, TestIndexingSequenceNumbers, TestMixedDocValuesUpdates, TestNRTReaderWithThreads, TestSimpleExplanationsOfNonMatches, TestBooleanScorer, TestIndexWriterOnVMError, TestIndexSorting, TestSegmentCacheables, TestCustomTermFreq, TestControlledRealTimeReopenThread, TestSleepingLockWrapper, TestMultiMMap, TestSegmentInfos, TestWildcardRandom, TestFieldValueQuery, TestFieldType, Test2BPostingsBytes, TestCharsRefBuilder, TestBlendedTermQuery, TestSortedNumericSortField, TestOperations, TestLucene50LiveDocsFormat, TestOfflineSorter, TestSearchWithThreads, TestFutureObjects, TestSpanNearQuery, TestCollectionUtil, TestBagOfPostings, TestReadOnlyIndex, TestIndexOrDocValuesQuery, TestSparseFixedBitDocIdSet, TestArrayUtil, TestFilterDirectory, TestPackedInts, TestSimilarity2, TestPolygon, TestIndexWriterOnJRECrash, TestDoubleRangeFieldQueries, TestFixedLengthBytesRefArray, TestGraphTokenStreamFiniteStrings, TestIndexWriterCommit, TestSpans, TestElevationComparator, TestCharacterUtils, TestTermdocPerf, TestDirectPacked, TestTopDocsMerge, TestBM25Similarity, TestRamUsageEstimator, TestSloppyPhraseQuery2, TestSpanTermQuery, TestDocsWithFieldSet, TestAxiomaticF1LOG, TestSmallFloat, TestExitableDirectoryReader, TestDirectoryReader, TestMixedCodecs, TestSpanBoostQuery, TestLongRange, TestRegexpQuery, TestHugeRamFile, TestTermStates, TestPayloadsOnVectors, TestPayloads, TestRoaringDocIdSet, TestCharTermAttributeImpl, TestParallelCompositeReader, TestAllFilesHaveCodecHeader, TestIndexWriterMerging, FuzzyTermOnShortTermsTest, TestClassicSimilarity, TestPositiveScoresOnlyCollector, TestFixedBitSet, TestComplexExplanations, TestNRTCachingDirectory, TestSegmentReader, TestFastDecompressionMode, TestFieldCacheRewriteMethod, TestPagedBytes, TestCrash, TestMultiThreadTermVectors, TestSegmentTermDocs, TestSort, TestMultiDocValues, TestSimpleSearchEquivalence, TestCustomNorms, TestPostingsOffsets, TestFlex, TestSpanExplanations, TestFastCompressionMode, TestStressIndexing2, TestRAMDirectory, TestMultiPhraseQuery, TestLazyProxSkipping, TestDeterminism, TestTermVectorsWriter, TestCodecs, TestOmitPositions, TestBytesRefHash, TestStressNRT, TestIndexInput, TestDisjunctionMaxQuery, TestOmitTf, TestNearSpansOrdered, TestMultiFields, TestTermRangeQuery, TestDocumentsWriterDeleteQueue, TestDocumentWriter, TestCrashCausesCorruptIndex, TestScorerPerf, TestLiveFieldValues, TestSpanSearchEquivalence, TestFieldMaskingSpanQuery, TestExternalCodecs, TestTermVectorsReader, TestTopDocsCollector, TestSegmentTermEnum, TestUniqueTermCount, TestBooleanQuery, TestComplexExplanationsOfNonMatches, TestUnicodeUtil, TestAutomatonQuery, TestParallelReaderEmptyIndex, TestDocument, TestMaxTermFrequency, TestTermScorer, TestSentinelIntSet, TestCheckIndex, TestCompiledAutomaton, TestConstantScoreQuery, TestMatchAllDocsQuery, TestBinaryTerms, TestSubScorerFreqs, TestRecyclingIntBlockAllocator, TestMultiTermQueryRewrites, TestDateSort, TestSpanExplanationsOfNonMatches, TestSimilarityProvider, TestSetOnce, TestFilterLeafReader, TestSearch, TestCachingTokenFilter, TestFilterIterator, TestCharsRef, TestSameTokenSamePosition, TestDocCount, TestCachingCollector, TestBinaryDocument, TestAutomatonQueryUnicode, TestAttributeSource, TestTotalHitCountCollector, TestSpanFirstQuery, TestIsCurrent, TestNoMergeScheduler, TestIndexWriterLockRelease, TestPhrasePrefixQuery, TestByteBlockPool, TestAssertions, TestCharFilter, TestRollback, TestFieldInfos, TestNot, TestCloseableThreadLocal, TestReaderClosed, MultiCollectorTest, TestNGramPhraseQuery, TestScoreCachingWrappingScorer, TestSimpleAttributeImpl, Test2BPositions, TestIOUtils, Test2BTerms, TestNewestSegment, Test2BNumericDocValues, TestCharArraySet, TestReusableStringReader, TestStopFilter, TestWordlistLoader, TestPackedTokenAttributeImpl, TestCodecUtil, TestCompetitiveFreqNormAccumulator, TestBlockPostingsFormat, TestLucene70SegmentInfoFormat, TestDoubleRange, TestFeatureField, TestGeoEncodingUtils, TestGeoUtils, TestPolygon2D, Test2BSortedDocValuesFixedSorted, Test2BSortedDocValuesOrds, TestAllFilesCheckIndexHeader, TestAllFilesDetectTruncation, TestBinaryDocValuesUpdates]
   [junit4] Completed [392/495 (2!)] on J2 in 48.29s, 29 tests, 1 error <<< FAILURES!

[...truncated 11354 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
   [junit4]   2> 9180 INFO  (SUITE-SearchRateTriggerTest-seed#[D66C2ADD4867CC79]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_D66C2ADD4867CC79-001/init-core-data-001
   [junit4]   2> 9644 INFO  (SUITE-SearchRateTriggerTest-seed#[D66C2ADD4867CC79]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 10122 INFO  (SUITE-SearchRateTriggerTest-seed#[D66C2ADD4867CC79]-worker) [    ] o.e.j.u.log Logging initialized @10203ms to org.eclipse.jetty.util.log.Slf4jLog
   [junit4]   2> 10160 INFO  (SUITE-SearchRateTriggerTest-seed#[D66C2ADD4867CC79]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 10240 INFO  (SUITE-SearchRateTriggerTest-seed#[D66C2ADD4867CC79]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_D66C2ADD4867CC79-001/tempDir-001
   [junit4]   2> 10382 INFO  (SUITE-SearchRateTriggerTest-seed#[D66C2ADD4867CC79]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 10406 INFO  (Thread-1) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 10406 INFO  (Thread-1) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 10601 INFO  (SUITE-SearchRateTriggerTest-seed#[D66C2ADD4867CC79]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:53182
   [junit4]   2> 10883 ERROR (Thread-1) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 11267 INFO  (zkConnectionManagerCallback-4-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 11353 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1063e5e08c70000, likely client has closed socket
   [junit4]   2> 12478 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 12488 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 12478 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 12489 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 12613 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 12613 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 12618 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 12680 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@720765ff{/solr,null,AVAILABLE}
   [junit4]   2> 13023 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 13023 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 13023 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 13024 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 13024 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 13024 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 13024 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 13025 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 13025 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 13040 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4297b252{/solr,null,AVAILABLE}
   [junit4]   2> 13049 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7d64d04f{HTTP/1.1,[http/1.1]}{127.0.0.1:38774}
   [junit4]   2> 13050 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.Server Started @13154ms
   [junit4]   2> 13050 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38774}
   [junit4]   2> 13090 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6080bbe8{/solr,null,AVAILABLE}
   [junit4]   2> 13091 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@726c3b{HTTP/1.1,[http/1.1]}{127.0.0.1:43410}
   [junit4]   2> 13091 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.Server Started @13196ms
   [junit4]   2> 13091 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43410}
   [junit4]   2> 13102 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3af0c563{/solr,null,AVAILABLE}
   [junit4]   2> 13103 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@70264c6c{HTTP/1.1,[http/1.1]}{127.0.0.1:36219}
   [junit4]   2> 13103 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.Server Started @13208ms
   [junit4]   2> 13103 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36219}
   [junit4]   2> 13104 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@426f84a4{HTTP/1.1,[http/1.1]}{127.0.0.1:54311}
   [junit4]   2> 13105 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.Server Started @13210ms
   [junit4]   2> 13105 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54311}
   [junit4]   2> 13224 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.u.c.SSLCredentialProviderFactory Processing SSL Credential Provider chain: env;sysprop
   [junit4]   2> 13454 ERROR (jetty-launcher-1-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 13455 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 13455 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 13460 ERROR (jetty-launcher-1-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 13460 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 13460 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 13461 ERROR (jetty-launcher-1-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 13462 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 13462 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 13474 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 13480 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 13480 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-17T13:37:39.579Z
   [junit4]   2> 13478 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 13482 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 13482 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-17T13:37:39.581Z
   [junit4]   2> 13478 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 13483 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 13483 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-17T13:37:39.582Z
   [junit4]   2> 13484 ERROR (jetty-launcher-1-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 13484 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 13485 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 13485 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 13485 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 13485 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-17T13:37:39.584Z
   [junit4]   2> 13555 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 13649 INFO  (zkConnectionManagerCallback-6-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13656 INFO  (zkConnectionManagerCallback-8-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13663 INFO  (zkConnectionManagerCallback-12-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13675 INFO  (zkConnectionManagerCallback-10-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13687 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 13688 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 13688 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 13694 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 14121 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1063e5e08c70004, likely client has closed socket
   [junit4]   2> 14122 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1063e5e08c70001, likely client has closed socket
   [junit4]   2> 15733 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53182/solr
   [junit4]   2> 15873 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53182/solr
   [junit4]   2> 15893 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53182/solr
   [junit4]   2> 15909 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53182/solr
   [junit4]   2> 16005 INFO  (zkConnectionManagerCallback-26-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 16013 INFO  (zkConnectionManagerCallback-28-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 16033 INFO  (zkConnectionManagerCallback-24-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 16088 INFO  (zkConnectionManagerCallback-22-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 16097 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1063e5e08c70008, likely client has closed socket
   [junit4]   2> 16237 INFO  (zkConnectionManagerCallback-30-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 16256 INFO  (zkConnectionManagerCallback-32-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 16473 INFO  (zkConnectionManagerCallback-34-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 16601 INFO  (zkConnectionManagerCallback-36-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 18968 INFO  (jetty-launcher-1-thread-4) [n:127.0.0.1:36219_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 18970 INFO  (jetty-launcher-1-thread-3) [n:127.0.0.1:43410_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 18970 INFO  (jetty-launcher-1-thread-2) [n:127.0.0.1:38774_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 18970 INFO  (jetty-launcher-1-thread-1) [n:127.0.0.1:54311_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 18978 INFO  (jetty-launcher-1-thread-2) [n:127.0.0.1:38774_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38774_solr
   [junit4]   2> 18982 INFO  (jetty-launcher-1-thread-1) [n:127.0.0.1:54311_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54311_solr
   [junit4]   2> 18988 INFO  (jetty-launcher-1-thread-3) [n:127.0.0.1:43410_solr    ] o.a.s.c

[...truncated too long message...]

Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null331050570
     [copy] Copying 39 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null331050570
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null331050570

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null1045387672
     [copy] Copying 246 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null1045387672
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null1045387672

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 67ms :: artifacts dl 9ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 406 minutes 12 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1543 - Failure

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1543/

All tests passed

Build Log:
[...truncated 13332 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180514_225601_6698428383225238040667.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid13151.hprof ...
   [junit4] Heap dump file created [629649687 bytes in 14.488 secs]
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180514_225601_6695398900644130964031.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] <<< JVM J0: EOF ----

[...truncated 2219 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_172/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=3616AC644BEBB39A -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.luceneMatchVersion=8.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/tools/junit4/logging.properties -Dtests.nightly=true -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/tools/junit4/solr-tests.policy -Dtests.LUCENE_VERSION=8.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Dtests.badapples=false -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/test-framework/lib/junit4-ant-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-solrj/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/common/lucene-analyzers-common-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/lucene-codecs-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/backward-codecs/lucene-backward-codecs-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/highlighter/lucene-highlighter-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/memory/lucene-memory-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/misc/lucene-misc-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/spatial-extras/lucene-spatial-extras-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/spatial3d/lucene-spatial3d-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/expressions/lucene-expressions-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/suggest/lucene-suggest-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/grouping/lucene-grouping-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/queries/lucene-queries-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/queryparser/lucene-queryparser-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/join/lucene-join-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/sandbox/lucene-sandbox-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/classification/lucene-classification-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/asm-5.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/asm-commons-5.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/avatica-core-1.10.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/caffeine-2.4.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/calcite-core-1.13.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/calcite-linq4j-1.13.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-cli-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-codec-1.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-compiler-2.7.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-configuration-1.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-exec-1.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-fileupload-1.3.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-io-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-lang-2.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-lang3-3.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/curator-client-2.8.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/curator-framework-2.8.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/curator-recipes-2.8.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/disruptor-3.4.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/dom4j-1.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/eigenbase-properties-1.1.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/guava-14.0.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-annotations-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-auth-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-common-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-hdfs-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hppc-0.7.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-annotations-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-core-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-core-asl-1.9.13.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-databind-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-dataformat-smile-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-mapper-asl-1.9.13.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/janino-2.7.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jcl-over-slf4j-1.7.24.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/joda-time-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-1.2-api-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-api-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-core-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-slf4j-impl-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/org.restlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/protobuf-java-3.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/spatial4j-0.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/t-digest-3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/commons-io-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/commons-math3-3.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/httpclient-4.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/httpcore-4.4.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/httpmime-4.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/jcl-over-slf4j-1.7.24.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/noggit-0.8.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/slf4j-api-1.7.24.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/stax2-api-3.1.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/zookeeper-3.4.11.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/gmetric4j-1.0.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/javax.servlet-api-3.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-continuation-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-deploy-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-http-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-io-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-jmx-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-rewrite-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-security-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-server-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-servlet-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-servlets-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-util-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-webapp-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-xml-9.4.10.v20180503.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-core-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-ganglia-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-graphite-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-jetty9-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-jvm-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/example/example-DIH/solr/db/lib/hsqldb-2.4.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/test-framework/lib/randomizedtesting-runner-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/antlr-2.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-api-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-avl-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-i18n-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptor-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/bcprov-jdk15on-1.54.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/byte-buddy-1.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/commons-math3-3.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-common-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-hdfs-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-minikdc-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-sslengine-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/mockito-core-2.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/objenesis-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/icu/lucene-analyzers-icu-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/backward-codecs/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/analysis-extras/lib/icu4j-61.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_172/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.6.0.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180514_225601_6698486854865420184975.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180514_225601_6695176979333204062101.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1540)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:577: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build.xml:267: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/common-build.xml:557: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:1568: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:1092: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.

Total time: 471 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-NightlyTests-master #1542 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1542 - Still unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1542/

2 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState

Error Message:
Did not expect the processor to fire on first run! event={   "id":"1e5fa474416150Tbpp7s7dm0rk2wxdqht3vxgww8",   "source":"node_added_trigger",   "eventTime":8549409231036752,   "eventType":"NODEADDED",   "properties":{     "eventTimes":[8549409231036752],     "nodeNames":["127.0.0.1:42316_solr"]}}

Stack Trace:
java.lang.AssertionError: Did not expect the processor to fire on first run! event={
  "id":"1e5fa474416150Tbpp7s7dm0rk2wxdqht3vxgww8",
  "source":"node_added_trigger",
  "eventTime":8549409231036752,
  "eventType":"NODEADDED",
  "properties":{
    "eventTimes":[8549409231036752],
    "nodeNames":["127.0.0.1:42316_solr"]}}
	at __randomizedtesting.SeedInfo.seed([A265B202A3119059:6CCB16915B28E84F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.lambda$new$0(NodeAddedTriggerTest.java:49)
	at org.apache.solr.cloud.autoscaling.NodeAddedTrigger.run(NodeAddedTrigger.java:161)
	at org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState(NodeAddedTriggerTest.java:257)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([A265B202A3119059:C1AE84803ADEE374]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger(SearchRateTriggerTest.java:133)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14173 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/init-core-data-001
   [junit4]   2> 2590317 WARN  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=12 numCloses=12
   [junit4]   2> 2590317 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2590319 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2590319 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2590332 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001
   [junit4]   2> 2590332 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2590339 INFO  (Thread-1524) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2590339 INFO  (Thread-1524) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2590347 ERROR (Thread-1524) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2590449 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39539
   [junit4]   2> 2590615 INFO  (zkConnectionManagerCallback-1465-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2590753 INFO  (jetty-launcher-1462-thread-1) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 2590753 INFO  (jetty-launcher-1462-thread-2) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 2590762 INFO  (jetty-launcher-1462-thread-3) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 2590762 INFO  (jetty-launcher-1462-thread-4) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 2590792 INFO  (jetty-launcher-1462-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2590792 INFO  (jetty-launcher-1462-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2590792 INFO  (jetty-launcher-1462-thread-3) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2590792 INFO  (jetty-launcher-1462-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22341ead{/solr,null,AVAILABLE}
   [junit4]   2> 2590900 INFO  (jetty-launcher-1462-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2590900 INFO  (jetty-launcher-1462-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2590900 INFO  (jetty-launcher-1462-thread-4) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2590900 INFO  (jetty-launcher-1462-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a97cd2d{/solr,null,AVAILABLE}
   [junit4]   2> 2590901 INFO  (jetty-launcher-1462-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@bb36194{HTTP/1.1,[http/1.1]}{127.0.0.1:46820}
   [junit4]   2> 2590972 INFO  (jetty-launcher-1462-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@240e928a{HTTP/1.1,[http/1.1]}{127.0.0.1:44761}
   [junit4]   2> 2590972 INFO  (jetty-launcher-1462-thread-4) [    ] o.e.j.s.Server Started @2591164ms
   [junit4]   2> 2590972 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44761}
   [junit4]   2> 2590972 ERROR (jetty-launcher-1462-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2590972 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2590973 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2590973 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2590973 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2590973 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-13T10:17:19.664Z
   [junit4]   2> 2590988 INFO  (zkConnectionManagerCallback-1467-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2590988 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2591016 INFO  (jetty-launcher-1462-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2591016 INFO  (jetty-launcher-1462-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2591016 INFO  (jetty-launcher-1462-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29129f56{/solr,null,AVAILABLE}
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@49c600e6{HTTP/1.1,[http/1.1]}{127.0.0.1:43472}
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.e.j.s.Server Started @2591209ms
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43472}
   [junit4]   2> 2591017 ERROR (jetty-launcher-1462-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2591017 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2591018 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-13T10:17:19.709Z
   [junit4]   2> 2591033 INFO  (jetty-launcher-1462-thread-3) [    ] o.e.j.s.Server Started @2591225ms
   [junit4]   2> 2591033 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46820}
   [junit4]   2> 2591033 ERROR (jetty-launcher-1462-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2591033 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2591034 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2591034 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2591034 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2591034 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-13T10:17:19.725Z
   [junit4]   2> 2591091 INFO  (jetty-launcher-1462-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2591091 INFO  (jetty-launcher-1462-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2591091 INFO  (jetty-launcher-1462-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2591092 INFO  (jetty-launcher-1462-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3c88990{/solr,null,AVAILABLE}
   [junit4]   2> 2591092 INFO  (jetty-launcher-1462-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3715b37c{HTTP/1.1,[http/1.1]}{127.0.0.1:38795}
   [junit4]   2> 2591143 INFO  (jetty-launcher-1462-thread-1) [    ] o.e.j.s.Server Started @2591335ms
   [junit4]   2> 2591143 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38795}
   [junit4]   2> 2591144 ERROR (jetty-launcher-1462-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2591144 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2591144 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2591144 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2591144 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2591144 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-13T10:17:19.835Z
   [junit4]   2> 2591126 INFO  (zkConnectionManagerCallback-1469-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591145 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2591159 INFO  (zkConnectionManagerCallback-1471-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591160 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2591203 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101fd43b4260002, likely client has closed socket
   [junit4]   2> 2591216 INFO  (zkConnectionManagerCallback-1473-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591217 INFO  (jetty-launcher-1462-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39539/solr
   [junit4]   2> 2591218 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2591252 INFO  (zkConnectionManagerCallback-1477-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591311 INFO  (jetty-launcher-1462-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39539/solr
   [junit4]   2> 2591365 INFO  (jetty-launcher-1462-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39539/solr
   [junit4]   2> 2591451 INFO  (zkConnectionManagerCallback-1486-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591488 INFO  (jetty-launcher-1462-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39539/solr
   [junit4]   2> 2591560 INFO  (zkConnectionManagerCallback-1482-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591580 INFO  (zkConnectionManagerCallback-1492-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591633 INFO  (zkConnectionManagerCallback-1488-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591670 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101fd43b4260008, likely client has closed socket
   [junit4]   2> 2591730 INFO  (zkConnectionManagerCallback-1495-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591864 INFO  (zkConnectionManagerCallback-1499-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591877 INFO  (zkConnectionManagerCallback-1497-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2591923 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2591923 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38795_solr
   [junit4]   2> 2591924 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.c.Overseer Overseer (id=72617536241664012-127.0.0.1:38795_solr-n_0000000000) starting
   [junit4]   2> 2592002 INFO  (zkConnectionManagerCallback-1506-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2592145 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39539/solr ready
   [junit4]   2> 2592284 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38795_solr
   [junit4]   2> 2592379 INFO  (zkCallback-1498-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2592469 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2592480 INFO  (zkCallback-1505-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2592508 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2592527 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2592565 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2592600 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2592600 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43472_solr
   [junit4]   2> 2592618 INFO  (zkCallback-1505-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2592618 INFO  (zkCallback-1498-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2592678 INFO  (zkCallback-1496-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2592801 INFO  (zkCallback-1494-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2592830 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2592830 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46820_solr
   [junit4]   2> 2592846 INFO  (zkCallback-1494-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2592858 INFO  (zkCallback-1505-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2592862 INFO  (zkCallback-1498-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2592874 INFO  (zkCallback-1496-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2593483 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38795.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2593502 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38795.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2593502 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38795.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2593531 INFO  (jetty-launcher-1462-thread-1) [n:127.0.0.1:38795_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node1/.
   [junit4]   2> 2593591 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46820.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2593743 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46820.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2593743 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46820.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2593744 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node3/.
   [junit4]   2> 2593777 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2593901 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2593904 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2593904 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44761_solr
   [junit4]   2> 2593913 INFO  (zkConnectionManagerCallback-1515-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2593973 INFO  (zkCallback-1496-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2593974 INFO  (zkCallback-1494-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2593974 INFO  (zkCallback-1505-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2593985 INFO  (zkCallback-1498-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2594083 INFO  (zkCallback-1485-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2594095 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2594087 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43472.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2594122 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43472.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2594122 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43472.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2594123 INFO  (jetty-launcher-1462-thread-3) [n:127.0.0.1:46820_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39539/solr ready
   [junit4]   2> 2594123 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node2/.
   [junit4]   2> 2594192 INFO  (zkConnectionManagerCallback-1520-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2594278 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2594367 INFO  (jetty-launcher-1462-thread-2) [n:127.0.0.1:43472_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39539/solr ready
   [junit4]   2> 2594855 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44761.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2594905 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44761.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2594905 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44761.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2594923 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node4/.
   [junit4]   2> 2594953 INFO  (zkConnectionManagerCallback-1525-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2594954 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2594968 INFO  (jetty-launcher-1462-thread-4) [n:127.0.0.1:44761_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39539/solr ready
   [junit4]   2> 2595148 INFO  (zkConnectionManagerCallback-1527-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2595174 INFO  (zkConnectionManagerCallback-1532-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2595223 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2595224 INFO  (SUITE-SearchRateTriggerTest-seed#[A265B202A3119059]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39539/solr ready
   [junit4]   2> 2595471 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[A265B202A3119059]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForElapsed
   [junit4]   2> 2595472 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[A265B202A3119059]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2595507 INFO  (qtp1236767958-5594) [n:127.0.0.1:44761_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=SearchRateTriggerTest-collection1&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2595521 INFO  (OverseerThreadFactory-1902-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection SearchRateTriggerTest-collection1
   [junit4]   2> 2595717 INFO  (OverseerStateUpdate-72617536241664012-127.0.0.1:38795_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38795/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2595732 INFO  (OverseerStateUpdate-72617536241664012-127.0.0.1:38795_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:46820/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2595852 INFO  (OverseerStateUpdate-72617536241664012-127.0.0.1:38795_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:44761/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2595890 INFO  (OverseerStateUpdate-72617536241664012-127.0.0.1:38795_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43472/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2596113 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2596113 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2596116 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr    x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n6&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2596137 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2596157 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr    x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n4&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2597166 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2597289 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 2597292 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2597292 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard1_replica_n2' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2597292 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46820.solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2' (registry 'solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2597293 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2597293 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node3/SearchRateTriggerTest-collection1_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node3/./SearchRateTriggerTest-collection1_shard1_replica_n2/data/]
   [junit4]   2> 2597374 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2597439 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2597458 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2597478 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2597509 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2597509 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard1_replica_n1' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2597510 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38795.solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1' (registry 'solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2597510 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2597510 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node1/SearchRateTriggerTest-collection1_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node1/./SearchRateTriggerTest-collection1_shard1_replica_n1/data/]
   [junit4]   2> 2597511 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 2597513 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 2597526 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2597526 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard2_replica_n4' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2597527 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44761.solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4' (registry 'solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2597527 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2597527 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node4/SearchRateTriggerTest-collection1_shard2_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node4/./SearchRateTriggerTest-collection1_shard2_replica_n4/data/]
   [junit4]   2> 2597531 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2597531 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard2_replica_n6' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2597532 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43472.solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6' (registry 'solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13728ce6
   [junit4]   2> 2597532 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2597532 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node2/SearchRateTriggerTest-collection1_shard2_replica_n6], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_A265B202A3119059-001/tempDir-001/node2/./SearchRateTriggerTest-collection1_shard2_replica_n6/data/]
   [junit4]   2> 2597980 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2597980 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2597981 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2597981 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2597983 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@35b465fc[SearchRateTriggerTest-collection1_shard1_replica_n2] main]
   [junit4]   2> 2598037 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2598053 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2598054 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2598054 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600343660817285120
   [junit4]   2> 2598056 INFO  (searcherExecutor-1911-thread-1-processing-n:127.0.0.1:46820_solr x:SearchRateTriggerTest-collection1_shard1_replica_n2 c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard1_replica_n2] Registered new searcher Searcher@35b465fc[SearchRateTriggerTest-collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2598185 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard1 to Terms{values={core_node5=0}, version=0}
   [junit4]   2> 2598200 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2598277 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2598277 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2598277 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2598277 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2598277 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2598277 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2598278 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2598278 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2598278 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2598278 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2598280 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2598280 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2598296 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@31884ad2[SearchRateTriggerTest-collection1_shard2_replica_n6] main]
   [junit4]   2> 2598297 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2598298 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2598298 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2598298 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600343661073137664
   [junit4]   2> 2598305 INFO  (searcherExecutor-1914-thread-1-processing-n:127.0.0.1:43472_solr x:SearchRateTriggerTest-collection1_shard2_replica_n6 c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard2_replica_n6] Registered new searcher Searcher@31884ad2[SearchRateTriggerTest-collection1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2598316 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@782ec761[SearchRateTriggerTest-collection1_shard1_replica_n1] main]
   [junit4]   2> 2598316 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1207290f[SearchRateTriggerTest-collection1_shard2_replica_n4] main]
   [junit4]   2> 2598317 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2598330 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2598331 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2598332 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2598332 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600343661108789248
   [junit4]   2> 2598332 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard2 to Terms{values={core_node8=0}, version=0}
   [junit4]   2> 2598351 INFO  (searcherExecutor-1913-thread-1-processing-n:127.0.0.1:44761_solr x:SearchRateTriggerTest-collection1_shard2_replica_n4 c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard2_replica_n4] Registered new searcher Searcher@1207290f[SearchRateTriggerTest-collection1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2598371 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2598371 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2598371 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600343661149683712
   [junit4]   2> 2598374 INFO  (searcherExecutor-1912-thread-1-processing-n:127.0.0.1:38795_solr x:SearchRateTriggerTest-collection1_shard1_replica_n1 c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard1_replica_n1] Registered new searcher Searcher@782ec761[SearchRateTriggerTest-collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2598387 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9991ms
   [junit4]   2> 2598389 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 2598441 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
   [junit4]   2> 2598701 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2598701 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2598701 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46820/solr/SearchRateTriggerTest-collection1_shard1_replica_n2/
   [junit4]   2> 2598702 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard1_replica_n2 url=http://127.0.0.1:46820/solr START replicas=[http://127.0.0.1:38795/solr/SearchRateTriggerTest-collection1_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 2598706 INFO  (qtp1548071514-5574) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.S.Request [SearchRateTriggerTest-collection1_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2598899 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2598899 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2598899 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43472/solr/SearchRateTriggerTest-collection1_shard2_replica_n6/
   [junit4]   2> 2598899 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard2_replica_n6 url=http://127.0.0.1:43472/solr START replicas=[http://127.0.0.1:44761/solr/SearchRateTriggerTest-collection1_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 2598921 INFO  (qtp1236767958-5588) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.S.Request [SearchRateTriggerTest-collection1_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 2599003 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard1_replica_n2 url=http://127.0.0.1:46820/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2599003 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2599003 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2599003 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2599011 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46820/solr/SearchRateTriggerTest-collection1_shard1_replica_n2/ shard1
   [junit4]   2> 2599216 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2599217 INFO  (qtp1906693275-5580) [n:127.0.0.1:46820_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3081
   [junit4]   2> 2599219 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard2_replica_n6 url=http://127.0.0.1:43472/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2599231 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2599231 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2599231 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2599235 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43472/solr/SearchRateTriggerTest-collection1_shard2_replica_n6/ shard2
   [junit4]   2> 2599358 INFO  (zkCallback-1496-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2599363 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2599365 INFO  (qtp687447188-5604) [n:127.0.0.1:43472_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n6&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3249
   [junit4]   2> 2599454 INFO  (qtp1548071514-5613) [n:127.0.0.1:38795_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3341
   [junit4]   2> 2599512 INFO  (qtp1236767958-5589) [n:127.0.0.1:44761_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n4&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3355
   [junit4]   2> 2599525 INFO  (qtp1236767958-5594) [n:127.0.0.1:44761_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2599541 INFO  (OverseerCollectionConfigSetProcessor-72617536241664012-127.0.0.1:38795_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2599614 INFO  (zkCallback-1498-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2599614 INFO  (zkCallback-1485-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2599614 INFO  (zkCallback-1494-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2599614 INFO  (zkCallback-1496-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2600525 INFO  (qtp1236767958-5594) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=SearchRateTriggerTest-collection1&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=5017
   [junit4]   2> 2600601 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=1
   [junit4]   2> 2600616 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2600649 INFO  (qtp1548071514-5585) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2600670 INFO  (qtp1906693275-5575) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2600798 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2600832 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2600833 INFO  (qtp1548071514-5585) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2600834 INFO  (qtp1906693275-5575) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2601861 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2601862 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2601863 INFO  (qtp1548071514-5585) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2601880 INFO  (qtp1906693275-5575) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2602896 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2602897 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2602898 INFO  (qtp1548071514-5585) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2602977 INFO  (qtp1906693275-5575) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=13
   [junit4]   2> 2603980 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2603982 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2603983 INFO  (qtp1548071514-5615) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2603996 INFO  (qtp1906693275-5579) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2605028 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2605029 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2605030 INFO  (qtp1548071514-5615) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2605071 INFO  (qtp1906693275-5579) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2606080 INFO  (qtp1236767958-5592) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2606082 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2606098 INFO  (qtp1548071514-5615) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2606129 INFO  (qtp1906693275-5579) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2607132 INFO  (qtp1236767958-5592) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2607133 INFO  (qtp687447188-5581) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2607143 INFO  (qtp1548071514-5614) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2607144 INFO  (qtp1906693275-5579) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2608170 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2608171 INFO  (qtp687447188-5603) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2608204 INFO  (qtp1548071514-5614) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2608221 INFO  (qtp1906693275-5578) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2609336 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2609342 INFO  (qtp687447188-5603) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2609343 INFO  (qtp1548071514-5614) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2609374 INFO  (qtp1906693275-5578) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610405 INFO  (qtp1236767958-5592) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610417 INFO  (qtp687447188-5603) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610418 INFO  (qtp1548071514-5614) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610419 INFO  (qtp1906693275-5578) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610438 INFO  (qtp1236767958-5591) [n:127.0.0.1:44761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610439 INFO  (qtp687447188-5602) [n:127.0.0.1:43472_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610440 INFO  (qtp1548071514-5615) [n:127.0.0.1:38795_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2610455 INFO  (qtp1906693275-5578) [n:127.0.0.1:46820_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=java

[...truncated too long message...]

length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null605932579
     [copy] Copying 40 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null605932579
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null605932579

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null339453643
     [copy] Copying 246 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null339453643
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null339453643

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 69ms :: artifacts dl 13ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 719 minutes 13 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

Re: [JENKINS] Lucene-Solr-NightlyTests-master - Build # 1541 - Still Failing

Posted by Adrien Grand <jp...@gmail.com>.
I'll remove this test.

Le ven. 11 mai 2018 à 13:50, Apache Jenkins Server <
jenkins@builds.apache.org> a écrit :

> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1541/
>
> 2 tests failed.
> FAILED:
> org.apache.lucene.codecs.simpletext.TestSimpleTextLiveDocsFormat.testOverflow
>
> Error Message:
> Java heap space
>
> Stack Trace:
> java.lang.OutOfMemoryError: Java heap space
>         at
> __randomizedtesting.SeedInfo.seed([97A9A7241DF6776D:AC018FCB1EC7F65B]:0)
>         at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
>         at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
>         at
> org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
>         at
> org.apache.lucene.store.RAMOutputStream.writeByte(RAMOutputStream.java:133)
>         at
> org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:48)
>         at
> org.apache.lucene.codecs.simpletext.SimpleTextLiveDocsFormat.writeLiveDocs(SimpleTextLiveDocsFormat.java:113)
>         at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
>         at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>
>
> FAILED:
> org.apache.lucene.codecs.lucene50.TestLucene50LiveDocsFormat.testOverflow
>
> Error Message:
> Java heap space
>
> Stack Trace:
> java.lang.OutOfMemoryError: Java heap space
>         at
> __randomizedtesting.SeedInfo.seed([BACA40CA979D1E99:8162682594AC9FAF]:0)
>         at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
>         at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
>         at
> org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
>         at
> org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
>         at
> org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
>         at
> org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:126)
>         at org.apache.lucene.store.DataOutput.writeInt(DataOutput.java:71)
>         at
> org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:213)
>         at
> org.apache.lucene.codecs.lucene50.Lucene50LiveDocsFormat.writeLiveDocs(Lucene50LiveDocsFormat.java:110)
>         at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
>         at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>
>
>
>
> Build Log:
> [...truncated 866 lines...]
>    [junit4] Suite:
> org.apache.lucene.codecs.lucene50.TestLucene50LiveDocsFormat
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by
> running 'ant get-jenkins-line-docs' in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=TestLucene50LiveDocsFormat -Dtests.method=testOverflow
> -Dtests.seed=BACA40CA979D1E99 -Dtests.multiplier=2 -Dtests.nightly=true
> -Dtests.slow=true
> -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
> -Dtests.locale=ar-EG -Dtests.timezone=Europe/Busingen -Dtests.asserts=true
> -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR    102s J2 | TestLucene50LiveDocsFormat.testOverflow <<<
>    [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([BACA40CA979D1E99:8162682594AC9FAF]:0)
>    [junit4]    >        at
> org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
>    [junit4]    >        at
> org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
>    [junit4]    >        at
> org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
>    [junit4]    >        at
> org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
>    [junit4]    >        at
> org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
>    [junit4]    >        at
> org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:126)
>    [junit4]    >        at
> org.apache.lucene.store.DataOutput.writeInt(DataOutput.java:71)
>    [junit4]    >        at
> org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:213)
>    [junit4]    >        at
> org.apache.lucene.codecs.lucene50.Lucene50LiveDocsFormat.writeLiveDocs(Lucene50LiveDocsFormat.java:110)
>    [junit4]    >        at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
>    [junit4]    >        at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
>    [junit4]   2> NOTE: leaving temporary files on disk at:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/J2/temp/lucene.codecs.lucene50.TestLucene50LiveDocsFormat_BACA40CA979D1E99-001
>    [junit4]   2> NOTE: test params are:
> codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
> chunkSize=30606, maxDocsPerChunk=4, blockSize=10),
> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
> chunkSize=30606, blockSize=10)),
> sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1a9b1bf5),
> locale=ar-EG, timezone=Europe/Busingen
>    [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation
> 1.8.0_172 (64-bit)/cpus=4,threads=1,free=269412304,total=533725184
>    [junit4]   2> NOTE: All tests run in this JVM: [TestMultiCollector,
> TestMixedDocValuesUpdates, TestComplexExplanationsOfNonMatches,
> TestControlledRealTimeReopenThread, TestIndexWriterReader, TestLongRange,
> TestBasics, TestRegexpQuery, TestDocsWithFieldSet, TestSpanBoostQuery,
> TestIndexWriterMergePolicy, TestCompiledAutomaton, TestFilterCodecReader,
> TestNRTThreads, TestNRTReaderWithThreads, TestReadOnlyIndex,
> TestSimpleFSDirectory, TestConsistentFieldNumbers, TestReaderClosed,
> FiniteStringsIteratorTest, TestSparseFixedBitDocIdSet, TestFutureObjects,
> FuzzyTermOnShortTermsTest, TestAxiomaticF3EXP, TestStopFilter,
> TestTermRangeQuery, TestBKD, TestSynonymQuery, TestSegmentTermEnum,
> TestPerFieldPostingsFormat2, TestSentinelIntSet,
> TestPositiveScoresOnlyCollector, TestSortedSetDocValues,
> TestExitableDirectoryReader, TestNIOFSDirectory, TestSearchWithThreads,
> TestIndexManyDocuments, TestRollingUpdates, TestNeedsScores,
> TestMultiTermQueryRewrites, TestRecyclingIntBlockAllocator, TestTermStates,
> TestIndexWriterCommit, TestDoubleRangeFieldQueries, TestManyFields,
> TestDateTools, TestFieldsReader, TestTopDocsMerge,
> TestSameTokenSamePosition, TestSimpleExplanationsOfNonMatches,
> TestSpanTermQuery, TestShardSearching, TestDocInverterPerFieldErrorInfo,
> TestIndependenceChiSquared, TestDocument, TestScorerPerf,
> Test2BSortedDocValuesFixedSorted, TestLucene70SegmentInfoFormat,
> TestMatchNoDocsQuery, TestMultiFields, TestIndexWriterMerging,
> TestFilterDirectory, TestNamedSPILoader, TestWildcardRandom,
> TestPackedTokenAttributeImpl, TestSegmentReader, TestBlendedTermQuery,
> TestSpanNearQuery, TestLucene50LiveDocsFormat]
>    [junit4] Completed [178/495 (1!)] on J2 in 101.59s, 4 tests, 1 error
> <<< FAILURES!
>
> [...truncated 1147 lines...]
>    [junit4] JVM J2: stdout was not empty, see:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/temp/junit4-J2-20180511_052626_8573789069166163672932.sysout
>    [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
>    [junit4] java.lang.OutOfMemoryError: Java heap space
>    [junit4] Dumping heap to
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid31830.hprof
> ...
>    [junit4] Heap dump file created [536292018 bytes in 2.869 secs]
>    [junit4] <<< JVM J2: EOF ----
>
> [...truncated 5614 lines...]
>    [junit4] Suite:
> org.apache.lucene.codecs.simpletext.TestSimpleTextLiveDocsFormat
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by
> running 'ant get-jenkins-line-docs' in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=TestSimpleTextLiveDocsFormat -Dtests.method=testOverflow
> -Dtests.seed=97A9A7241DF6776D -Dtests.multiplier=2 -Dtests.nightly=true
> -Dtests.slow=true
> -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
> -Dtests.locale=is -Dtests.timezone=America/Bahia_Banderas
> -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
>    [junit4] ERROR    203s J2 | TestSimpleTextLiveDocsFormat.testOverflow
> <<<
>    [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([97A9A7241DF6776D:AC018FCB1EC7F65B]:0)
>    [junit4]    >        at
> org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
>    [junit4]    >        at
> org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
>    [junit4]    >        at
> org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
>    [junit4]    >        at
> org.apache.lucene.store.RAMOutputStream.writeByte(RAMOutputStream.java:133)
>    [junit4]    >        at
> org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:48)
>    [junit4]    >        at
> org.apache.lucene.codecs.simpletext.SimpleTextLiveDocsFormat.writeLiveDocs(SimpleTextLiveDocsFormat.java:113)
>    [junit4]    >        at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
>    [junit4]    >        at
> org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
>    [junit4]   2> NOTE: leaving temporary files on disk at:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/test/J2/temp/lucene.codecs.simpletext.TestSimpleTextLiveDocsFormat_97A9A7241DF6776D-001
>    [junit4]   2> NOTE: test params are: codec=CheapBastard,
> sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1aa53427),
> locale=is, timezone=America/Bahia_Banderas
>    [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation
> 1.8.0_172 (64-bit)/cpus=4,threads=1,free=264397256,total=477626368
>    [junit4]   2> NOTE: All tests run in this JVM:
> [TestFixedGapPostingsFormat, TestFSTPostingsFormat,
> TestDirectPostingsFormat, TestSimpleTextLiveDocsFormat]
>    [junit4] Completed [5/19 (1!)] on J2 in 203.53s, 4 tests, 1 error <<<
> FAILURES!
>
> [...truncated 71 lines...]
>    [junit4] JVM J2: stdout was not empty, see:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/test/temp/junit4-J2-20180511_080916_9998513066334616091460.sysout
>    [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
>    [junit4] java.lang.OutOfMemoryError: Java heap space
>    [junit4] Dumping heap to
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid7944.hprof
> ...
>    [junit4] Heap dump file created [484866645 bytes in 0.949 secs]
>    [junit4] <<< JVM J2: EOF ----
>
> [...truncated 17540 lines...]
> BUILD FAILED
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:585:
> Some of the tests produced a heap dump, but did not fail. Maybe a
> suppressed OutOfMemoryError? Dumps created:
> * java_pid31830.hprof
> * java_pid7944.hprof
>
> Total time: 382 minutes 5 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1541 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1541/

2 tests failed.
FAILED:  org.apache.lucene.codecs.simpletext.TestSimpleTextLiveDocsFormat.testOverflow

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
	at __randomizedtesting.SeedInfo.seed([97A9A7241DF6776D:AC018FCB1EC7F65B]:0)
	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
	at org.apache.lucene.store.RAMOutputStream.writeByte(RAMOutputStream.java:133)
	at org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:48)
	at org.apache.lucene.codecs.simpletext.SimpleTextLiveDocsFormat.writeLiveDocs(SimpleTextLiveDocsFormat.java:113)
	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)


FAILED:  org.apache.lucene.codecs.lucene50.TestLucene50LiveDocsFormat.testOverflow

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
	at __randomizedtesting.SeedInfo.seed([BACA40CA979D1E99:8162682594AC9FAF]:0)
	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
	at org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
	at org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
	at org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:126)
	at org.apache.lucene.store.DataOutput.writeInt(DataOutput.java:71)
	at org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:213)
	at org.apache.lucene.codecs.lucene50.Lucene50LiveDocsFormat.writeLiveDocs(Lucene50LiveDocsFormat.java:110)
	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)




Build Log:
[...truncated 866 lines...]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50LiveDocsFormat
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLucene50LiveDocsFormat -Dtests.method=testOverflow -Dtests.seed=BACA40CA979D1E99 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=ar-EG -Dtests.timezone=Europe/Busingen -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    102s J2 | TestLucene50LiveDocsFormat.testOverflow <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([BACA40CA979D1E99:8162682594AC9FAF]:0)
   [junit4]    > 	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
   [junit4]    > 	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
   [junit4]    > 	at org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
   [junit4]    > 	at org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:126)
   [junit4]    > 	at org.apache.lucene.store.DataOutput.writeInt(DataOutput.java:71)
   [junit4]    > 	at org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:213)
   [junit4]    > 	at org.apache.lucene.codecs.lucene50.Lucene50LiveDocsFormat.writeLiveDocs(Lucene50LiveDocsFormat.java:110)
   [junit4]    > 	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
   [junit4]    > 	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/J2/temp/lucene.codecs.lucene50.TestLucene50LiveDocsFormat_BACA40CA979D1E99-001
   [junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=30606, maxDocsPerChunk=4, blockSize=10), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=30606, blockSize=10)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1a9b1bf5), locale=ar-EG, timezone=Europe/Busingen
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=269412304,total=533725184
   [junit4]   2> NOTE: All tests run in this JVM: [TestMultiCollector, TestMixedDocValuesUpdates, TestComplexExplanationsOfNonMatches, TestControlledRealTimeReopenThread, TestIndexWriterReader, TestLongRange, TestBasics, TestRegexpQuery, TestDocsWithFieldSet, TestSpanBoostQuery, TestIndexWriterMergePolicy, TestCompiledAutomaton, TestFilterCodecReader, TestNRTThreads, TestNRTReaderWithThreads, TestReadOnlyIndex, TestSimpleFSDirectory, TestConsistentFieldNumbers, TestReaderClosed, FiniteStringsIteratorTest, TestSparseFixedBitDocIdSet, TestFutureObjects, FuzzyTermOnShortTermsTest, TestAxiomaticF3EXP, TestStopFilter, TestTermRangeQuery, TestBKD, TestSynonymQuery, TestSegmentTermEnum, TestPerFieldPostingsFormat2, TestSentinelIntSet, TestPositiveScoresOnlyCollector, TestSortedSetDocValues, TestExitableDirectoryReader, TestNIOFSDirectory, TestSearchWithThreads, TestIndexManyDocuments, TestRollingUpdates, TestNeedsScores, TestMultiTermQueryRewrites, TestRecyclingIntBlockAllocator, TestTermStates, TestIndexWriterCommit, TestDoubleRangeFieldQueries, TestManyFields, TestDateTools, TestFieldsReader, TestTopDocsMerge, TestSameTokenSamePosition, TestSimpleExplanationsOfNonMatches, TestSpanTermQuery, TestShardSearching, TestDocInverterPerFieldErrorInfo, TestIndependenceChiSquared, TestDocument, TestScorerPerf, Test2BSortedDocValuesFixedSorted, TestLucene70SegmentInfoFormat, TestMatchNoDocsQuery, TestMultiFields, TestIndexWriterMerging, TestFilterDirectory, TestNamedSPILoader, TestWildcardRandom, TestPackedTokenAttributeImpl, TestSegmentReader, TestBlendedTermQuery, TestSpanNearQuery, TestLucene50LiveDocsFormat]
   [junit4] Completed [178/495 (1!)] on J2 in 101.59s, 4 tests, 1 error <<< FAILURES!

[...truncated 1147 lines...]
   [junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/temp/junit4-J2-20180511_052626_8573789069166163672932.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid31830.hprof ...
   [junit4] Heap dump file created [536292018 bytes in 2.869 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 5614 lines...]
   [junit4] Suite: org.apache.lucene.codecs.simpletext.TestSimpleTextLiveDocsFormat
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSimpleTextLiveDocsFormat -Dtests.method=testOverflow -Dtests.seed=97A9A7241DF6776D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=is -Dtests.timezone=America/Bahia_Banderas -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR    203s J2 | TestSimpleTextLiveDocsFormat.testOverflow <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([97A9A7241DF6776D:AC018FCB1EC7F65B]:0)
   [junit4]    > 	at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
   [junit4]    > 	at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
   [junit4]    > 	at org.apache.lucene.store.RAMOutputStream.writeByte(RAMOutputStream.java:133)
   [junit4]    > 	at org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:48)
   [junit4]    > 	at org.apache.lucene.codecs.simpletext.SimpleTextLiveDocsFormat.writeLiveDocs(SimpleTextLiveDocsFormat.java:113)
   [junit4]    > 	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
   [junit4]    > 	at org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/test/J2/temp/lucene.codecs.simpletext.TestSimpleTextLiveDocsFormat_97A9A7241DF6776D-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1aa53427), locale=is, timezone=America/Bahia_Banderas
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=264397256,total=477626368
   [junit4]   2> NOTE: All tests run in this JVM: [TestFixedGapPostingsFormat, TestFSTPostingsFormat, TestDirectPostingsFormat, TestSimpleTextLiveDocsFormat]
   [junit4] Completed [5/19 (1!)] on J2 in 203.53s, 4 tests, 1 error <<< FAILURES!

[...truncated 71 lines...]
   [junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/test/temp/junit4-J2-20180511_080916_9998513066334616091460.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid7944.hprof ...
   [junit4] Heap dump file created [484866645 bytes in 0.949 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 17540 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:585: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid31830.hprof
* java_pid7944.hprof

Total time: 382 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1540 - Failure

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1540/

All tests passed

Build Log:
[...truncated 14740 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180509_064700_5746633983320824388545.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid24022.hprof ...
   [junit4] Heap dump file created [581232247 bytes in 7.627 secs]
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180509_064700_5746022965787957474895.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 	at java.nio.CharBuffer.wrap(CharBuffer.java:373)
   [junit4] 	at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:265)
   [junit4] 	at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125)
   [junit4] 	at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:113)
   [junit4] 	at java.io.OutputStreamWriter.write(OutputStreamWriter.java:194)
   [junit4] 	at java.io.Writer.append(Writer.java:293)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.beforeValue(JsonWriter.java:634)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.open(JsonWriter.java:321)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.beginObject(JsonWriter.java:304)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.events.AppendStdErrEvent.serialize(AppendStdErrEvent.java:29)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:119)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:114)
   [junit4] 	at java.security.AccessController.doPrivileged(Native Method)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:114)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:99)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$3$2.write(SlaveMain.java:472)
   [junit4] 	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
   [junit4] 	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
   [junit4] 	at java.io.PrintStream.flush(PrintStream.java:338)
   [junit4] 	at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
   [junit4] 	at java.io.PrintStream.write(PrintStream.java:482)
   [junit4] 	at org.apache.logging.log4j.core.util.CloseShieldOutputStream.write(CloseShieldOutputStream.java:53)
   [junit4] 	at org.apache.logging.log4j.core.appender.OutputStreamManager.writeToDestination(OutputStreamManager.java:263)
   [junit4] 	at org.apache.logging.log4j.core.appender.OutputStreamManager.flushBuffer(OutputStreamManager.jav
   [junit4] a:295)
   [junit4] 	at org.apache.logging.log4j.core.appender.OutputStreamManager.flush(OutputStreamManager.java:304)
   [junit4] 	at org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.directEncodeEvent(AbstractOutputStreamAppender.java:179)
   [junit4] 	at org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.tryAppend(AbstractOutputStreamAppender.java:170)
   [junit4] 	at org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.append(AbstractOutputStreamAppender.java:161)
   [junit4] 	at org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:156)
   [junit4] 	at org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:129)
   [junit4] 	at org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:120)
   [junit4] 	at org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:84)
   [junit4] <<< JVM J0: EOF ----

[...truncated 974 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_172/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=4438410C4C232CA5 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.luceneMatchVersion=8.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/tools/junit4/logging.properties -Dtests.nightly=true -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/tools/junit4/solr-tests.policy -Dtests.LUCENE_VERSION=8.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Dtests.badapples=false -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/test-framework/lib/junit4-ant-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-solrj/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/common/lucene-analyzers-common-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/codecs/lucene-codecs-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/backward-codecs/lucene-backward-codecs-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/highlighter/lucene-highlighter-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/memory/lucene-memory-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/misc/lucene-misc-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/spatial-extras/lucene-spatial-extras-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/spatial3d/lucene-spatial3d-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/expressions/lucene-expressions-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/suggest/lucene-suggest-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/grouping/lucene-grouping-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/queries/lucene-queries-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/queryparser/lucene-queryparser-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/join/lucene-join-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/sandbox/lucene-sandbox-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/classification/lucene-classification-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/asm-5.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/asm-commons-5.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/avatica-core-1.10.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/caffeine-2.4.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/calcite-core-1.13.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/calcite-linq4j-1.13.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-cli-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-codec-1.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-compiler-2.7.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-configuration-1.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-exec-1.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-fileupload-1.3.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-io-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-lang-2.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/commons-lang3-3.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/curator-client-2.8.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/curator-framework-2.8.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/curator-recipes-2.8.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/disruptor-3.4.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/dom4j-1.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/eigenbase-properties-1.1.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/guava-14.0.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-annotations-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-auth-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-common-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hadoop-hdfs-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/hppc-0.7.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-annotations-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-core-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-core-asl-1.9.13.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-databind-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-dataformat-smile-2.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jackson-mapper-asl-1.9.13.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/janino-2.7.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/jcl-over-slf4j-1.7.24.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/joda-time-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-1.2-api-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-api-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-core-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/log4j-slf4j-impl-2.11.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/org.restlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/protobuf-java-3.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/spatial4j-0.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/lib/t-digest-3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/commons-io-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/commons-math3-3.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/httpclient-4.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/httpcore-4.4.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/httpmime-4.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/jcl-over-slf4j-1.7.24.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/noggit-0.8.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/slf4j-api-1.7.24.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/stax2-api-3.1.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/solrj/lib/zookeeper-3.4.11.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/gmetric4j-1.0.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/javax.servlet-api-3.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-continuation-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-deploy-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-http-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-io-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-jmx-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-rewrite-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-security-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-server-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-servlet-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-servlets-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-util-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-webapp-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/jetty-xml-9.4.8.v20171121.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-core-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-ganglia-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-graphite-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-jetty9-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/server/lib/metrics-jvm-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/example/example-DIH/solr/db/lib/hsqldb-2.4.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/antlr-2.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-api-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-avl-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-core-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-i18n-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptor-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/bcprov-jdk15on-1.54.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/byte-buddy-1.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/commons-math3-3.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-common-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-hdfs-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/hadoop-minikdc-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-sslengine-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/mockito-core-2.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/test-lib/objenesis-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/analysis/icu/lucene-analyzers-icu-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/backward-codecs/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/analysis-extras/lib/icu4j-61.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_172/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180509_064700_5747959565408090105214.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20180509_064700_5748253233864052723635.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1540)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:577: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build.xml:267: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/common-build.xml:557: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:1568: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:1092: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.

Total time: 388 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-NightlyTests-master #1539 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1539 - Still Unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1539/

2 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration

Error Message:
last state: DocCollection(testSplitIntegration_collection//clusterstate.json/40)={   "replicationFactor":"2",   "pullReplicas":"0",   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0",   "autoCreated":"true",   "shards":{     "shard2":{       "replicas":{         "core_node3":{           "core":"testSplitIntegration_collection_shard2_replica_n3",           "leader":"true",           "SEARCHER.searcher.maxDoc":11,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10001_solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":11},         "core_node4":{           "core":"testSplitIntegration_collection_shard2_replica_n4",           "SEARCHER.searcher.maxDoc":11,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10000_solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":11}},       "range":"0-7fffffff",       "state":"active"},     "shard1":{       "stateTimestamp":"1525714553704979100",       "replicas":{         "core_node1":{           "core":"testSplitIntegration_collection_shard1_replica_n1",           "leader":"true",           "SEARCHER.searcher.maxDoc":14,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10001_solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":14},         "core_node2":{           "core":"testSplitIntegration_collection_shard1_replica_n2",           "SEARCHER.searcher.maxDoc":14,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10000_solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":14}},       "range":"80000000-ffffffff",       "state":"inactive"},     "shard1_1":{       "parent":"shard1",       "stateTimestamp":"1525714553738107800",       "range":"c0000000-ffffffff",       "state":"active",       "replicas":{         "core_node10":{           "leader":"true",           "core":"testSplitIntegration_collection_shard1_1_replica1",           "SEARCHER.searcher.maxDoc":6,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10000_solr",           "base_url":"http://127.0.0.1:10000/solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":6},         "core_node9":{           "core":"testSplitIntegration_collection_shard1_1_replica0",           "SEARCHER.searcher.maxDoc":6,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10001_solr",           "base_url":"http://127.0.0.1:10001/solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":6}}},     "shard1_0":{       "parent":"shard1",       "stateTimestamp":"1525714553737785050",       "range":"80000000-bfffffff",       "state":"active",       "replicas":{         "core_node7":{           "leader":"true",           "core":"testSplitIntegration_collection_shard1_0_replica0",           "SEARCHER.searcher.maxDoc":7,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10001_solr",           "base_url":"http://127.0.0.1:10001/solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":7},         "core_node8":{           "core":"testSplitIntegration_collection_shard1_0_replica1",           "SEARCHER.searcher.maxDoc":7,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":1,           "node_name":"127.0.0.1:10000_solr",           "base_url":"http://127.0.0.1:10000/solr",           "state":"active",           "type":"NRT",           "SEARCHER.searcher.numDocs":7}}}}}

Stack Trace:
java.util.concurrent.TimeoutException: last state: DocCollection(testSplitIntegration_collection//clusterstate.json/40)={
  "replicationFactor":"2",
  "pullReplicas":"0",
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0",
  "autoCreated":"true",
  "shards":{
    "shard2":{
      "replicas":{
        "core_node3":{
          "core":"testSplitIntegration_collection_shard2_replica_n3",
          "leader":"true",
          "SEARCHER.searcher.maxDoc":11,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10001_solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":11},
        "core_node4":{
          "core":"testSplitIntegration_collection_shard2_replica_n4",
          "SEARCHER.searcher.maxDoc":11,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10000_solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":11}},
      "range":"0-7fffffff",
      "state":"active"},
    "shard1":{
      "stateTimestamp":"1525714553704979100",
      "replicas":{
        "core_node1":{
          "core":"testSplitIntegration_collection_shard1_replica_n1",
          "leader":"true",
          "SEARCHER.searcher.maxDoc":14,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10001_solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":14},
        "core_node2":{
          "core":"testSplitIntegration_collection_shard1_replica_n2",
          "SEARCHER.searcher.maxDoc":14,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10000_solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":14}},
      "range":"80000000-ffffffff",
      "state":"inactive"},
    "shard1_1":{
      "parent":"shard1",
      "stateTimestamp":"1525714553738107800",
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node10":{
          "leader":"true",
          "core":"testSplitIntegration_collection_shard1_1_replica1",
          "SEARCHER.searcher.maxDoc":6,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10000_solr",
          "base_url":"http://127.0.0.1:10000/solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":6},
        "core_node9":{
          "core":"testSplitIntegration_collection_shard1_1_replica0",
          "SEARCHER.searcher.maxDoc":6,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10001_solr",
          "base_url":"http://127.0.0.1:10001/solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":6}}},
    "shard1_0":{
      "parent":"shard1",
      "stateTimestamp":"1525714553737785050",
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node7":{
          "leader":"true",
          "core":"testSplitIntegration_collection_shard1_0_replica0",
          "SEARCHER.searcher.maxDoc":7,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10001_solr",
          "base_url":"http://127.0.0.1:10001/solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":7},
        "core_node8":{
          "core":"testSplitIntegration_collection_shard1_0_replica1",
          "SEARCHER.searcher.maxDoc":7,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":1,
          "node_name":"127.0.0.1:10000_solr",
          "base_url":"http://127.0.0.1:10000/solr",
          "state":"active",
          "type":"NRT",
          "SEARCHER.searcher.numDocs":7}}}}}
	at __randomizedtesting.SeedInfo.seed([E3EB9A89B90B0625:DA6523C996F4CFDB]:0)
	at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:111)
	at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:299)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger

Error Message:
waitFor not elapsed but produced an event

Stack Trace:
java.lang.AssertionError: waitFor not elapsed but produced an event
	at __randomizedtesting.SeedInfo.seed([E3EB9A89B90B0625:8020AC0B20C47508]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger(IndexSizeTriggerTest.java:180)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14154 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
   [junit4]   2> 3447747 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E3EB9A89B90B0625-001/init-core-data-001
   [junit4]   2> 3447749 WARN  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1467 numCloses=1467
   [junit4]   2> 3447749 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 3447751 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 3447751 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E3EB9A89B90B0625-001/tempDir-001
   [junit4]   2> 3447751 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3447751 INFO  (Thread-124769) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3447751 INFO  (Thread-124769) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3447754 ERROR (Thread-124769) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3447851 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:45900
   [junit4]   2> 3447855 INFO  (zkConnectionManagerCallback-50938-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3447862 INFO  (jetty-launcher-50935-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3447863 INFO  (jetty-launcher-50935-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3447875 INFO  (jetty-launcher-50935-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3447875 INFO  (jetty-launcher-50935-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3447875 INFO  (jetty-launcher-50935-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 3447875 INFO  (jetty-launcher-50935-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3447875 INFO  (jetty-launcher-50935-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3447875 INFO  (jetty-launcher-50935-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 3447876 INFO  (jetty-launcher-50935-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3b1e05e6{/solr,null,AVAILABLE}
   [junit4]   2> 3447877 INFO  (jetty-launcher-50935-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@29a936a9{HTTP/1.1,[http/1.1]}{127.0.0.1:52638}
   [junit4]   2> 3447877 INFO  (jetty-launcher-50935-thread-2) [    ] o.e.j.s.Server Started @3447965ms
   [junit4]   2> 3447878 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52638}
   [junit4]   2> 3447878 ERROR (jetty-launcher-50935-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3447878 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3447878 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 3447878 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3447878 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3447878 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-07T17:34:55.676Z
   [junit4]   2> 3447895 INFO  (jetty-launcher-50935-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45d78389{/solr,null,AVAILABLE}
   [junit4]   2> 3447895 INFO  (jetty-launcher-50935-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@52d85218{HTTP/1.1,[http/1.1]}{127.0.0.1:57945}
   [junit4]   2> 3447895 INFO  (jetty-launcher-50935-thread-1) [    ] o.e.j.s.Server Started @3447983ms
   [junit4]   2> 3447896 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=57945}
   [junit4]   2> 3447896 ERROR (jetty-launcher-50935-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3447896 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3447896 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 3447896 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3447896 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3447896 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-07T17:34:55.694Z
   [junit4]   2> 3447907 INFO  (zkConnectionManagerCallback-50940-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3447909 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3447909 INFO  (zkConnectionManagerCallback-50942-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3447941 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3447978 INFO  (jetty-launcher-50935-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45900/solr
   [junit4]   2> 3448007 INFO  (jetty-launcher-50935-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45900/solr
   [junit4]   2> 3448097 INFO  (zkConnectionManagerCallback-50946-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3448130 INFO  (zkConnectionManagerCallback-50952-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3448256 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3448257 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52638_solr
   [junit4]   2> 3448258 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.c.Overseer Overseer (id=73759327542771716-127.0.0.1:52638_solr-n_0000000000) starting
   [junit4]   2> 3448274 INFO  (zkConnectionManagerCallback-50959-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3448276 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45900/solr ready
   [junit4]   2> 3448409 DEBUG (OverseerAutoScalingTriggerThread-73759327542771716-127.0.0.1:52638_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 3448410 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52638_solr
   [junit4]   2> 3448411 DEBUG (OverseerAutoScalingTriggerThread-73759327542771716-127.0.0.1:52638_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 3448412 DEBUG (OverseerAutoScalingTriggerThread-73759327542771716-127.0.0.1:52638_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 3448412 DEBUG (OverseerAutoScalingTriggerThread-73759327542771716-127.0.0.1:52638_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 3448433 INFO  (zkCallback-50951-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3448467 INFO  (zkCallback-50958-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3448514 INFO  (zkConnectionManagerCallback-50950-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3448524 DEBUG (OverseerAutoScalingTriggerThread-73759327542771716-127.0.0.1:52638_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:52638_solr]
   [junit4]   2> 3448541 DEBUG (ScheduledTrigger-6851-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 3448661 DEBUG (OverseerAutoScalingTriggerThread-73759327542771716-127.0.0.1:52638_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3448661 DEBUG (OverseerAutoScalingTriggerThread-73759327542771716-127.0.0.1:52638_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 3448661 INFO  (zkConnectionManagerCallback-50961-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3448668 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3448670 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3448672 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3448672 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57945_solr
   [junit4]   2> 3448674 INFO  (zkCallback-50951-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3448674 INFO  (zkCallback-50958-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3448713 INFO  (zkCallback-50960-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3448791 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52638.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3927d54a
   [junit4]   2> 3448804 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52638.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3927d54a
   [junit4]   2> 3448805 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52638.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3927d54a
   [junit4]   2> 3448813 INFO  (jetty-launcher-50935-thread-2) [n:127.0.0.1:52638_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E3EB9A89B90B0625-001/tempDir-001/node2/.
   [junit4]   2> 3449133 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57945.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3927d54a
   [junit4]   2> 3449143 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57945.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3927d54a
   [junit4]   2> 3449143 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57945.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3927d54a
   [junit4]   2> 3449144 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E3EB9A89B90B0625-001/tempDir-001/node1/.
   [junit4]   2> 3449148 INFO  (zkConnectionManagerCallback-50968-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3449149 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 3449152 INFO  (jetty-launcher-50935-thread-1) [n:127.0.0.1:57945_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45900/solr ready
   [junit4]   2> 3449223 INFO  (zkConnectionManagerCallback-50970-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3449230 INFO  (zkConnectionManagerCallback-50975-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3449232 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 3449238 INFO  (SUITE-IndexSizeTriggerTest-seed#[E3EB9A89B90B0625]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45900/solr ready
   [junit4]   2> 3449271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 3449271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 3449271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 3449271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 3449274 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
   [junit4]   2> 3449275 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3449275 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 3449276 DEBUG (ScheduledTrigger-6860-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449297 DEBUG (ScheduledTrigger-6860-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449317 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449338 DEBUG (ScheduledTrigger-6860-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449358 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449378 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449398 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449419 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449439 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449459 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449485 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449505 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449515 INFO  (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[E3EB9A89B90B0625]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSplitIntegration
   [junit4]   2> 3449692 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449693 DEBUG (ScheduledTrigger-6851-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449713 DEBUG (ScheduledTrigger-6860-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449733 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449762 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449771 DEBUG (simCloudManagerPool-6859-thread-7) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1: {"core_node1":{
   [junit4]   2>     "core":"testSplitIntegration_collection_shard1_replica_n1",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":1,
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.numDocs":0,
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testSplitIntegration_collection"}}
   [junit4]   2> 3449782 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449802 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449825 DEBUG (ScheduledTrigger-6860-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449832 DEBUG (simCloudManagerPool-6859-thread-8) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3449833 DEBUG (simCloudManagerPool-6859-thread-8) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 3449836 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 3449837 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3449837 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 3449845 DEBUG (ScheduledTrigger-6860-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449862 DEBUG (simCloudManagerPool-6859-thread-9) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3449862 DEBUG (simCloudManagerPool-6859-thread-9) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 3449863 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 3449863 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3449863 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 3449865 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449885 DEBUG (ScheduledTrigger-6860-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449886 DEBUG (simCloudManagerPool-6859-thread-10) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3449886 DEBUG (simCloudManagerPool-6859-thread-10) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 3449887 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 3449887 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3449887 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 3449906 DEBUG (ScheduledTrigger-6860-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449928 DEBUG (ScheduledTrigger-6860-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449949 DEBUG (ScheduledTrigger-6860-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449969 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3449989 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450009 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450029 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450050 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450070 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450090 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450110 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450117 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}
   [junit4]   2> 3450131 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger, .auto_add_replicas, .scheduled_maintenance]
   [junit4]   2> 3450133 INFO  (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25966438571386821, stage=STARTED, actionName='null', event={
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={}, config={
   [junit4]   2>   "trigger":"index_size_trigger",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"]}, message='null'}
   [junit4]   2> 3450204 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}
   [junit4]   2> 3450221 INFO  (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25966442997769221, stage=BEFORE_ACTION, actionName='compute_plan', event={
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={
   [junit4]   2>   "trigger":"index_size_trigger",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"]}, message='null'}
   [junit4]   2> 3450221 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
   [junit4]   2> 3450225 INFO  (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
   [junit4]   2> 3450225 INFO  (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 25966443222 sessionWrapper.createTime 25966443071067371, this.sessionWrapper.createTime 25966443071067371 
   [junit4]   2> 3450226 INFO  (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25966443228429421, stage=AFTER_ACTION, actionName='compute_plan', event={
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
   [junit4]   2>   "trigger":"index_size_trigger",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"]}, message='null'}
   [junit4]   2> 3450226 INFO  (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25966443248945571, stage=BEFORE_ACTION, actionName='execute_plan', event={
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
   [junit4]   2>   "trigger":"index_size_trigger",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"]}, message='null'}
   [junit4]   2> 3450229 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ExecutePlanAction -- processing event: {
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@70030932], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]}
   [junit4]   2> 3450230 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
   [junit4]   2> 3450377 DEBUG (simCloudManagerPool-6859-thread-39) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2: {"core_node3":{
   [junit4]   2>     "core":"testSplitIntegration_collection_shard2_replica_n3",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":11,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":1,
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.numDocs":11,
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testSplitIntegration_collection"}}
   [junit4]   2> 3450379 INFO  (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25966450907245921, stage=AFTER_ACTION, actionName='execute_plan', event={
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
   [junit4]   2>   "trigger":"index_size_trigger",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"]}, message='null'}
   [junit4]   2> 3450380 INFO  (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25966450938580771, stage=SUCCEEDED, actionName='null', event={
   [junit4]   2>   "id":"5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm",
   [junit4]   2>   "source":"index_size_trigger",
   [junit4]   2>   "eventTime":25966423980445821,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n    \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n    \"leader\":\"true\",\n    \"SEARCHER.searcher.maxDoc\":11,\n    \"SEARCHER.searcher.deletedDocs\":0,\n    \"INDEX.sizeInBytes\":1,\n    \"__docs__\":11,\n    \"violationType\":\"aboveDocs\",\n    \"node_name\":\"127.0.0.1:10001_solr\",\n    \"state\":\"active\",\n    \"type\":\"NRT\",\n    \"SEARCHER.searcher.numDocs\":11,\n    \"__bytes__\":1,\n    \"shard\":\"shard1\",\n    \"collection\":\"testSplitIntegration_collection\"}}"]},
   [junit4]   2>     "belowSize":{},
   [junit4]   2>     "_enqueue_time_":25966438507761671,
   [junit4]   2>     "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n  \"first\":\"testSplitIntegration_collection\",\n  \"second\":\"shard1\"}]}}"]}}, context={}, config={
   [junit4]   2>   "trigger":"index_size_trigger",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"]}, message='null'}
   [junit4]   2> 3450393 DEBUG (simCloudManagerPool-6859-thread-42) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_0: {"core_node7":{
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":7,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":1,
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "base_url":"http://127.0.0.1:10001/solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.numDocs":7,
   [junit4]   2>     "core":"testSplitIntegration_collection_shard1_0_replica0",
   [junit4]   2>     "shard":"shard1_0",
   [junit4]   2>     "collection":"testSplitIntegration_collection"}}
   [junit4]   2> 3450392 DEBUG (simCloudManagerPool-6859-thread-41) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_1: {"core_node10":{
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":6,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":1,
   [junit4]   2>     "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>     "base_url":"http://127.0.0.1:10000/solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.numDocs":6,
   [junit4]   2>     "core":"testSplitIntegration_collection_shard1_1_replica1",
   [junit4]   2>     "shard":"shard1_1",
   [junit4]   2>     "collection":"testSplitIntegration_collection"}}
   [junit4]   2> 3450394 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: index_size_trigger after 100ms
   [junit4]   2> 3450394 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 3450394 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
   [junit4]   2> 3450394 DEBUG (AutoscalingActionExecutor-6861-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing took 9486 ms for event id=5c40533571107dTdd3ptjqo5if5cgeo2a5d7xfhm
   [junit4]   2> 3450494 DEBUG (ScheduledTrigger-6860-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450514 DEBUG (ScheduledTrigger-6860-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450555 DEBUG (ScheduledTrigger-6860-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450576 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450601 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450607 INFO  (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[E3EB9A89B90B0625]) [    ] o.a.s.c.a.IndexSizeTriggerTest #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:		2
   [junit4]   2> ## Empty nodes:	0
   [junit4]   2> ## Dead nodes:		0
   [junit4]   2> ## Collections:	[testSplitIntegration_collection]
   [junit4]   2> DocCollection(testSplitIntegration_collection//clusterstate.json/40)={
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"2",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testSplitIntegration_collection_shard2_replica_n3",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":11,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":11},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testSplitIntegration_collection_shard2_replica_n4",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":11,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":11}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "stateTimestamp":"1525714553704979100",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":"testSplitIntegration_collection_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":14,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":14},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           "core":"testSplitIntegration_collection_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":14,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":14}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"inactive"},
   [junit4]   2>     "shard1_1":{
   [junit4]   2>       "parent":"shard1",
   [junit4]   2>       "stateTimestamp":"1525714553738107800",
   [junit4]   2>       "range":"c0000000-ffffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node10":{
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "core":"testSplitIntegration_collection_shard1_1_replica1",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":6,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:10000/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":6},
   [junit4]   2>         "core_node9":{
   [junit4]   2>           "core":"testSplitIntegration_collection_shard1_1_replica0",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":6,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:10001/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":6}}},
   [junit4]   2>     "shard1_0":{
   [junit4]   2>       "parent":"shard1",
   [junit4]   2>       "stateTimestamp":"1525714553737785050",
   [junit4]   2>       "range":"80000000-bfffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node7":{
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "core":"testSplitIntegration_collection_shard1_0_replica0",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":7,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:10001/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":7},
   [junit4]   2>         "core_node8":{
   [junit4]   2>           "core":"testSplitIntegration_collection_shard1_0_replica1",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":7,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:10000/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":7}}}}}
   [junit4]   2> ## Max replicas per node:	4
   [junit4]   2> ## Min replicas per node:	4
   [junit4]   2> ## Total replicas:		8
   [junit4]   2> ## * testSplitIntegration_collection		8
   [junit4]   2> ##		- active           8
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ##		- CREATE             1
   [junit4]   2> ##		- DELETESTATUS       1
   [junit4]   2> ##		- REQUESTSTATUS      1
   [junit4]   2> ##		- SPLITSHARD         1
   [junit4]   2> ##		- autoscaling        3
   [junit4]   2> ##		- update            28
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: index_size_trigger
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> 
   [junit4]   2> 3450607 DEBUG (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[E3EB9A89B90B0625]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 3450621 DEBUG (ScheduledTrigger-6860-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450622 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 3450622 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3450623 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3450623 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 3450695 DEBUG (ScheduledTrigger-6851-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3450723 INFO  (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[E3EB9A89B90B0625]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSplitIntegration
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=IndexSizeTriggerTest -Dtests.method=testSplitIntegration -Dtests.seed=E3EB9A89B90B0625 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=el -Dtests.timezone=NST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   1.25s J2 | IndexSizeTriggerTest.testSplitIntegration <<<
   [junit4]    > Throwable #1: java.util.concurrent.TimeoutException: last state: DocCollection(testSplitIntegration_collection//clusterstate.json/40)={
   [junit4]    >   "replicationFactor":"2",
   [junit4]    >   "pullReplicas":"0",
   [junit4]    >   "router":{"name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"2",
   [junit4]    >   "autoAddReplicas":"false",
   [junit4]    >   "nrtReplicas":"2",
   [junit4]    >   "tlogReplicas":"0",
   [junit4]    >   "autoCreated":"true",
   [junit4]    >   "shards":{
   [junit4]    >     "shard2":{
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node3":{
   [junit4]    >           "core":"testSplitIntegration_collection_shard2_replica_n3",
   [junit4]    >           "leader":"true",
   [junit4]    >           "SEARCHER.searcher.maxDoc":11,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10001_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":11},
   [junit4]    >         "core_node4":{
   [junit4]    >           "core":"testSplitIntegration_collection_shard2_replica_n4",
   [junit4]    >           "SEARCHER.searcher.maxDoc":11,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10000_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":11}},
   [junit4]    >       "range":"0-7fffffff",
   [junit4]    >       "state":"active"},
   [junit4]    >     "shard1":{
   [junit4]    >       "stateTimestamp":"1525714553704979100",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node1":{
   [junit4]    >           "core":"testSplitIntegration_collection_shard1_replica_n1",
   [junit4]    >           "leader":"true",
   [junit4]    >           "SEARCHER.searcher.maxDoc":14,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10001_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":14},
   [junit4]    >         "core_node2":{
   [junit4]    >           "core":"testSplitIntegration_collection_shard1_replica_n2",
   [junit4]    >           "SEARCHER.searcher.maxDoc":14,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10000_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":14}},
   [junit4]    >       "range":"80000000-ffffffff",
   [junit4]    >       "state":"inactive"},
   [junit4]    >     "shard1_1":{
   [junit4]    >       "parent":"shard1",
   [junit4]    >       "stateTimestamp":"1525714553738107800",
   [junit4]    >       "range":"c0000000-ffffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node10":{
   [junit4]    >           "leader":"true",
   [junit4]    >           "core":"testSplitIntegration_collection_shard1_1_replica1",
   [junit4]    >           "SEARCHER.searcher.maxDoc":6,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10000_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:10000/solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":6},
   [junit4]    >         "core_node9":{
   [junit4]    >           "core":"testSplitIntegration_collection_shard1_1_replica0",
   [junit4]    >           "SEARCHER.searcher.maxDoc":6,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10001_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:10001/solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":6}}},
   [junit4]    >     "shard1_0":{
   [junit4]    >       "parent":"shard1",
   [junit4]    >       "stateTimestamp":"1525714553737785050",
   [junit4]    >       "range":"80000000-bfffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node7":{
   [junit4]    >           "leader":"true",
   [junit4]    >           "core":"testSplitIntegration_collection_shard1_0_replica0",
   [junit4]    >           "SEARCHER.searcher.maxDoc":7,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10001_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:10001/solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":7},
   [junit4]    >         "core_node8":{
   [junit4]    >           "core":"testSplitIntegration_collection_shard1_0_replica1",
   [junit4]    >           "SEARCHER.searcher.maxDoc":7,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":1,
   [junit4]    >           "node_name":"127.0.0.1:10000_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:10000/solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "SEARCHER.searcher.numDocs":7}}}}}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E3EB9A89B90B0625:DA6523C996F4CFDB]:0)
   [junit4]    > 	at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:111)
   [junit4]    > 	at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:299)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3450848 INFO  (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[E3EB9A89B90B0625]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMixedBounds
   [junit4]   2> 3450848 WARN  (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[E3EB9A89B90B0625]) [    ] o.a.s.c.a.IndexSizeTriggerTest Requires SOLR-12208
   [junit4]   2> 3450848 INFO  (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[E3EB9A89B90B0625]) [    ] o.a.s.c.a.IndexSizeTriggerTest #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:		2
   [junit4]   2> ## Empty nodes:	2
   [junit4]   2> ## Dead nodes:		0
   [junit4]   2> ## Collections:	[]
   [junit4]   2> ## Max replicas per node:	0
   [junit4]   2> ## Min replicas per node:	0
   [junit4]   2> ## Total replicas:		0
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: index_size_trigger
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> 
   [junit4]   2> 3450849 DEBUG (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[E3EB9A89B90B0625]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 3450849 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 3450849 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3450849 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3450849 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 3450949 INFO  (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[E3EB9A89B90B0625]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMixedBounds
   [junit4]   2> 3450999 INFO  (TEST-IndexSizeTriggerTest.testTrigger-seed#[E3EB9A89B90B0625]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger
   [junit4]   2> 3451283 DEBUG (simCloudManagerPool-6859-thread-52) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{
   [junit4]   2>     "core":"testTrigger_collection_shard1_replica_n1",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":1,
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.numDocs":0,
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testTrigger_collection"}}
   [junit4]   2> 3451292 DEBUG (simCloudManagerPool-6859-thread-51) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{
   [junit4]   2>     "core":"testTrigger_collection_shard2_replica_n3",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":1,
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.numDocs":0,
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testTrigger_collection"}}
   [junit4]   2> 3451384 INFO  (TEST-IndexSizeTriggerTest.testTrigger-seed#[E3EB9A89B90B0625]) [    ] o.a.s.c.a.IndexSizeTriggerTest #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:		2
   [junit4]   2> ## Empty nodes:	0
   [junit4]   2> ## Dead nodes:		0
   [junit4]   2> ## Collections:	[testTrigger_collection]
   [junit4]   2> DocCollection(testTrigger_collection//clusterstate.json/70)={
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"2",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testTrigger_collection_shard2_replica_n3",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":11,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":11},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testTrigger_collection_shard2_replica_n4",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":11,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":11}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":"testTrigger_collection_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":14,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":14},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           "core":"testTrigger_collection_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":14,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":14}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> ## Max replicas per node:	2
   [junit4]   2> ## Min replicas per node:	2
   [junit4]   2> ## Total replicas:		4
   [junit4]   2> ## * testTrigger_collection		4
   [junit4]   2> ##		- active           4
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ##		- CREATE             1
   [junit4]   2> ##		- update            26
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: index_size_trigger
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> 
   [junit4]   2> 3451384 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[E3EB9A89B90B0625]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 3451386 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 3451386 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3451386 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3451386 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 3451487 INFO  (TEST-IndexSizeTriggerTest.testTrigger-seed#[E3EB9A89B90B0625]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=IndexSizeTriggerTest -Dtests.method=testTrigger -Dtests.seed=E3EB9A89B90B0625 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=el -Dtests.timezone=NST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.54s J2 | IndexSizeTriggerTest.testTrigger <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: waitFor not elapsed but produced an event
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E3EB9A89B90B0625:8020AC0B20C47508]:0)
   [junit4]    > 	at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger(IndexSizeTriggerTest.java:180)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3451693 INFO  (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[E3EB9A89B90B0625]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMergeIntegration
   [junit4]   2> 3451695 DEBUG (ScheduledTrigger-6851-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3451763 DEBUG (simCloudManagerPool-6859-thread-84) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard2: {"core_node3":{
   [jun

[...truncated too long message...]

 Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null2057727474
     [copy] Copying 40 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null2057727474
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null2057727474

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null60546930
     [copy] Copying 246 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null60546930
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null60546930

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 296ms :: artifacts dl 12ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 454 minutes 55 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1538 - Still unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1538/

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionContextKeyTest

Error Message:
Could not load collection from ZK: testCollection1

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: testCollection1
	at __randomizedtesting.SeedInfo.seed([B60225E5447CD6C7]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1301)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:730)
	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:148)
	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:131)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
	at org.apache.solr.cloud.LeaderElectionContextKeyTest.setupCluster(LeaderElectionContextKeyTest.java:66)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testCollection1/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:340)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:340)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1313)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1299)
	... 29 more




Build Log:
[...truncated 14167 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderElectionContextKeyTest
   [junit4]   2> 2468401 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/init-core-data-001
   [junit4]   2> 2468402 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2468404 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2468405 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001
   [junit4]   2> 2468405 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2468438 INFO  (Thread-3150) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2468438 INFO  (Thread-3150) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2468455 ERROR (Thread-3150) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2468511 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:36026
   [junit4]   2> 2468746 INFO  (zkConnectionManagerCallback-1733-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2469039 INFO  (jetty-launcher-1730-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2469148 INFO  (jetty-launcher-1730-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2469148 INFO  (jetty-launcher-1730-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2469148 INFO  (jetty-launcher-1730-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2469149 INFO  (jetty-launcher-1730-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d522f88{/solr,null,AVAILABLE}
   [junit4]   2> 2469150 INFO  (jetty-launcher-1730-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@11088986{SSL,[ssl, http/1.1]}{127.0.0.1:44844}
   [junit4]   2> 2469150 INFO  (jetty-launcher-1730-thread-1) [    ] o.e.j.s.Server Started @2469432ms
   [junit4]   2> 2469150 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44844}
   [junit4]   2> 2469151 ERROR (jetty-launcher-1730-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2469151 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2469151 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2469151 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2469151 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2469151 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-05T04:41:45.299Z
   [junit4]   2> 2469193 INFO  (zkConnectionManagerCallback-1735-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2469194 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2469279 INFO  (jetty-launcher-1730-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36026/solr
   [junit4]   2> 2469296 INFO  (zkConnectionManagerCallback-1739-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2469412 INFO  (zkConnectionManagerCallback-1741-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2471891 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2471892 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44844_solr
   [junit4]   2> 2471892 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.c.Overseer Overseer (id=72570918227083267-127.0.0.1:44844_solr-n_0000000000) starting
   [junit4]   2> 2472073 INFO  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2472075 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36026/solr ready
   [junit4]   2> 2472147 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44844_solr
   [junit4]   2> 2472231 INFO  (zkCallback-1740-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2472292 INFO  (zkCallback-1747-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2473197 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44844.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@539f285e
   [junit4]   2> 2473306 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44844.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@539f285e
   [junit4]   2> 2473306 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44844.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@539f285e
   [junit4]   2> 2473307 INFO  (jetty-launcher-1730-thread-1) [n:127.0.0.1:44844_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/.
   [junit4]   2> 2473446 INFO  (zkConnectionManagerCallback-1750-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2473551 INFO  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2473552 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2473553 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36026/solr ready
   [junit4]   2> 2474263 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=config&maxShardsPerNode=100&name=testCollection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2474315 INFO  (OverseerThreadFactory-3099-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testCollection1
   [junit4]   2> 2474351 WARN  (OverseerThreadFactory-3099-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (testCollection1) without cores.
   [junit4]   2> 2474545 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2474545 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=config&maxShardsPerNode=100&name=testCollection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2} status=0 QTime=282
   [junit4]   2> 2474581 INFO  (qtp1807502144-8824) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=testCollection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2474671 INFO  (OverseerCollectionConfigSetProcessor-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2474690 INFO  (OverseerThreadFactory-3099-thread-2) [ c:testCollection1 s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44844_solr for creating new replica
   [junit4]   2> 2474770 INFO  (OverseerStateUpdate-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"testCollection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testCollection1_shard1_replica_n41",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44844/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44844_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2475133 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr    x:testCollection1_shard1_replica_n41] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node42&collection.configName=config&name=testCollection1_shard1_replica_n41&action=CREATE&collection=testCollection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2475133 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr    x:testCollection1_shard1_replica_n41] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2475191 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2475226 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.s.IndexSchema [testCollection1_shard1_replica_n41] Schema name=minimal
   [junit4]   2> 2475241 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2475241 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'testCollection1_shard1_replica_n41' using configuration from collection testCollection1, trusted=true
   [junit4]   2> 2475243 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44844.solr.core.testCollection1.shard1.replica_n41' (registry 'solr.core.testCollection1.shard1.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@539f285e
   [junit4]   2> 2475243 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2475243 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SolrCore [[testCollection1_shard1_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/testCollection1_shard1_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/./testCollection1_shard1_replica_n41/data/]
   [junit4]   2> 2475710 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2475710 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2475712 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2475712 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2475725 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@6becfe30[testCollection1_shard1_replica_n41] main]
   [junit4]   2> 2475727 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 2475727 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 2475728 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2475784 INFO  (searcherExecutor-3102-thread-1-processing-n:127.0.0.1:44844_solr x:testCollection1_shard1_replica_n41 c:testCollection1 s:shard1 r:core_node42) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SolrCore [testCollection1_shard1_replica_n41] Registered new searcher Searcher@6becfe30[testCollection1_shard1_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2475784 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599597772204408832
   [junit4]   2> 2475819 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testCollection1/terms/shard1 to Terms{values={core_node42=0}, version=0}
   [junit4]   2> 2475821 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2475821 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2475821 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44844/solr/testCollection1_shard1_replica_n41/
   [junit4]   2> 2475822 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2475822 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SyncStrategy https://127.0.0.1:44844/solr/testCollection1_shard1_replica_n41/ has no replicas
   [junit4]   2> 2475822 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2475837 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44844/solr/testCollection1_shard1_replica_n41/ shard1
   [junit4]   2> 2475995 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2475998 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node42&collection.configName=config&name=testCollection1_shard1_replica_n41&action=CREATE&collection=testCollection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=865
   [junit4]   2> 2476000 INFO  (qtp1807502144-8824) [n:127.0.0.1:44844_solr c:testCollection1   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=testCollection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1418
   [junit4]   2> 2476009 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=testCollection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2476011 INFO  (OverseerCollectionConfigSetProcessor-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2476038 INFO  (OverseerThreadFactory-3099-thread-3) [ c:testCollection1 s:shard2  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44844_solr for creating new replica
   [junit4]   2> 2476041 INFO  (OverseerStateUpdate-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"testCollection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testCollection1_shard2_replica_n43",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44844/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44844_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2476159 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2476253 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr    x:testCollection1_shard2_replica_n43] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node44&collection.configName=config&name=testCollection1_shard2_replica_n43&action=CREATE&collection=testCollection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2476312 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2476340 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.s.IndexSchema [testCollection1_shard2_replica_n43] Schema name=minimal
   [junit4]   2> 2476355 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2476355 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'testCollection1_shard2_replica_n43' using configuration from collection testCollection1, trusted=true
   [junit4]   2> 2476356 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44844.solr.core.testCollection1.shard2.replica_n43' (registry 'solr.core.testCollection1.shard2.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@539f285e
   [junit4]   2> 2476356 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2476356 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SolrCore [[testCollection1_shard2_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/testCollection1_shard2_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/./testCollection1_shard2_replica_n43/data/]
   [junit4]   2> 2476382 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2476631 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2476631 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2476632 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2476632 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2476634 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@46a4a96f[testCollection1_shard2_replica_n43] main]
   [junit4]   2> 2476647 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 2476647 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 2476648 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2476668 INFO  (searcherExecutor-3107-thread-1-processing-n:127.0.0.1:44844_solr x:testCollection1_shard2_replica_n43 c:testCollection1 s:shard2 r:core_node44) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SolrCore [testCollection1_shard2_replica_n43] Registered new searcher Searcher@46a4a96f[testCollection1_shard2_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2476668 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599597773131350016
   [junit4]   2> 2476688 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testCollection1/terms/shard2 to Terms{values={core_node44=0}, version=0}
   [junit4]   2> 2476690 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2476690 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2476690 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44844/solr/testCollection1_shard2_replica_n43/
   [junit4]   2> 2476690 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2476690 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SyncStrategy https://127.0.0.1:44844/solr/testCollection1_shard2_replica_n43/ has no replicas
   [junit4]   2> 2476690 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2476693 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44844/solr/testCollection1_shard2_replica_n43/ shard2
   [junit4]   2> 2476808 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2476844 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2476875 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node44&collection.configName=config&name=testCollection1_shard2_replica_n43&action=CREATE&collection=testCollection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=621
   [junit4]   2> 2476877 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr c:testCollection1   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=testCollection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=868
   [junit4]   2> 2476899 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=config&maxShardsPerNode=100&name=testCollection2&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2476912 INFO  (OverseerCollectionConfigSetProcessor-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2476912 INFO  (OverseerThreadFactory-3099-thread-4) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testCollection2
   [junit4]   2> 2476913 WARN  (OverseerThreadFactory-3099-thread-4) [    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (testCollection2) without cores.
   [junit4]   2> 2477069 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2477163 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2477163 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=config&maxShardsPerNode=100&name=testCollection2&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2} status=0 QTime=264
   [junit4]   2> 2477164 INFO  (qtp1807502144-8824) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=testCollection2&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2477165 INFO  (OverseerCollectionConfigSetProcessor-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2477253 INFO  (OverseerThreadFactory-3099-thread-5) [ c:testCollection2 s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44844_solr for creating new replica
   [junit4]   2> 2477255 INFO  (OverseerStateUpdate-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"testCollection2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testCollection2_shard1_replica_n41",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44844/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44844_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2477547 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr    x:testCollection2_shard1_replica_n41] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node42&collection.configName=config&name=testCollection2_shard1_replica_n41&action=CREATE&collection=testCollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2477615 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2477651 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.s.IndexSchema [testCollection2_shard1_replica_n41] Schema name=minimal
   [junit4]   2> 2477672 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2477672 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'testCollection2_shard1_replica_n41' using configuration from collection testCollection2, trusted=true
   [junit4]   2> 2477672 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44844.solr.core.testCollection2.shard1.replica_n41' (registry 'solr.core.testCollection2.shard1.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@539f285e
   [junit4]   2> 2477673 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2477673 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SolrCore [[testCollection2_shard1_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/testCollection2_shard1_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/./testCollection2_shard1_replica_n41/data/]
   [junit4]   2> 2477895 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2477895 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2477896 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2477896 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2477910 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a007823[testCollection2_shard1_replica_n41] main]
   [junit4]   2> 2477911 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 2477911 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 2477912 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2477912 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599597774435778560
   [junit4]   2> 2477913 INFO  (searcherExecutor-3112-thread-1-processing-n:127.0.0.1:44844_solr x:testCollection2_shard1_replica_n41 c:testCollection2 s:shard1 r:core_node42) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SolrCore [testCollection2_shard1_replica_n41] Registered new searcher Searcher@1a007823[testCollection2_shard1_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2477943 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testCollection2/terms/shard1 to Terms{values={core_node42=0}, version=0}
   [junit4]   2> 2477955 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2477955 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2477955 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44844/solr/testCollection2_shard1_replica_n41/
   [junit4]   2> 2477955 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2477955 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SyncStrategy https://127.0.0.1:44844/solr/testCollection2_shard1_replica_n41/ has no replicas
   [junit4]   2> 2477955 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2477968 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44844/solr/testCollection2_shard1_replica_n41/ shard1
   [junit4]   2> 2478071 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2478146 INFO  (qtp1807502144-8828) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node42&collection.configName=config&name=testCollection2_shard1_replica_n41&action=CREATE&collection=testCollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=599
   [junit4]   2> 2478181 INFO  (qtp1807502144-8824) [n:127.0.0.1:44844_solr c:testCollection2   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=testCollection2&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1017
   [junit4]   2> 2478182 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=testCollection2&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2478184 INFO  (OverseerThreadFactory-3099-thread-5) [ c:testCollection2 s:shard2  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44844_solr for creating new replica
   [junit4]   2> 2478186 INFO  (OverseerCollectionConfigSetProcessor-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2478197 INFO  (OverseerStateUpdate-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"testCollection2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testCollection2_shard2_replica_n43",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44844/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44844_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2478311 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2478388 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr    x:testCollection2_shard2_replica_n43] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node44&collection.configName=config&name=testCollection2_shard2_replica_n43&action=CREATE&collection=testCollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2478426 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2488533 WARN  (jetty-launcher-1730-thread-1-SendThread(127.0.0.1:36026)) [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 10335ms for sessionid 0x101d2dd99f30004
   [junit4]   2> 2488533 WARN  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker-SendThread(127.0.0.1:36026)) [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 11566ms for sessionid 0x101d2dd99f30006
   [junit4]   2> 2488533 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101d2dd99f30006, likely client has closed socket
   [junit4]   2> 2488534 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101d2dd99f30004, likely client has closed socket
   [junit4]   2> 2488553 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2488568 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.s.IndexSchema [testCollection2_shard2_replica_n43] Schema name=minimal
   [junit4]   2> 2488570 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2488570 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'testCollection2_shard2_replica_n43' using configuration from collection testCollection2, trusted=true
   [junit4]   2> 2488571 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44844.solr.core.testCollection2.shard2.replica_n43' (registry 'solr.core.testCollection2.shard2.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@539f285e
   [junit4]   2> 2488571 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2488571 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SolrCore [[testCollection2_shard2_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/testCollection2_shard2_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderElectionContextKeyTest_B60225E5447CD6C7-001/tempDir-001/node1/./testCollection2_shard2_replica_n43/data/]
   [junit4]   2> 2488678 WARN  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2c561bd8 name: ZooKeeperConnection Watcher:127.0.0.1:36026/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 2488678 WARN  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 2488678 WARN  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@52007649 name: ZooKeeperConnection Watcher:127.0.0.1:36026/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 2488678 WARN  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 2488876 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2488876 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2488877 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2488877 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2488878 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@34f46f75[testCollection2_shard2_replica_n43] main]
   [junit4]   2> 2488912 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 2488913 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 2488913 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2488913 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599597785971163136
   [junit4]   2> 2488950 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testCollection2/terms/shard2 to Terms{values={core_node44=0}, version=0}
   [junit4]   2> 2488952 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2488952 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2488952 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44844/solr/testCollection2_shard2_replica_n43/
   [junit4]   2> 2488952 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2488952 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SyncStrategy https://127.0.0.1:44844/solr/testCollection2_shard2_replica_n43/ has no replicas
   [junit4]   2> 2488952 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2489012 INFO  (searcherExecutor-3117-thread-1-processing-n:127.0.0.1:44844_solr x:testCollection2_shard2_replica_n43 c:testCollection2 s:shard2 r:core_node44) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SolrCore [testCollection2_shard2_replica_n43] Registered new searcher Searcher@34f46f75[testCollection2_shard2_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2489023 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44844/solr/testCollection2_shard2_replica_n43/ shard2
   [junit4]   2> 2489124 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2489139 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2489141 INFO  (qtp1807502144-8827) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node44&collection.configName=config&name=testCollection2_shard2_replica_n43&action=CREATE&collection=testCollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=10753
   [junit4]   2> 2489233 INFO  (qtp1807502144-8826) [n:127.0.0.1:44844_solr c:testCollection2   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=testCollection2&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=11051
   [junit4]   2> 2489233 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: testCollection1 failOnTimeout:true timeout (sec):30
   [junit4]   2> 2489249 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2489772 WARN  (jetty-launcher-1730-thread-1-SendThread(127.0.0.1:36026)) [    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x101d2dd99f30004 has expired
   [junit4]   2> 2489784 WARN  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2c561bd8 name: ZooKeeperConnection Watcher:127.0.0.1:36026/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
   [junit4]   2> 2489784 WARN  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 2489785 WARN  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 2489804 INFO  (zkConnectionManagerCallback-1748-thread-1-EventThread) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2489804 INFO  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 2489884 INFO  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 2489884 INFO  (zkConnectionManagerCallback-1748-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient Connected:true
   [junit4]   2> 2489991 WARN  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker-SendThread(127.0.0.1:36026)) [    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x101d2dd99f30006 has expired
   [junit4]   2> 2489991 WARN  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@52007649 name: ZooKeeperConnection Watcher:127.0.0.1:36026/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
   [junit4]   2> 2489991 WARN  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 2489991 WARN  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 2490039 INFO  (zkConnectionManagerCallback-1755-thread-1-EventThread) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490039 INFO  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 2490130 INFO  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 2490130 INFO  (zkConnectionManagerCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient Connected:true
   [junit4]   2> 2490267 INFO  (jetty-closer-1731-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@11088986{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2490282 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1944770019
   [junit4]   2> 2490303 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2490311 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7369a781: rootName = solr_44844, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2ae4d63e
   [junit4]   2> 2490385 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2490385 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2eb157fa: rootName = solr_44844, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@29c9d8f1
   [junit4]   2> 2490387 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2490387 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2f2f524e: rootName = solr_44844, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@76a185f6
   [junit4]   2> 2490603 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44844_solr
   [junit4]   2> 2490620 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2490639 INFO  (coreCloseExecutor-3122-thread-1) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.c.SolrCore [testCollection1_shard1_replica_n41]  CLOSING SolrCore org.apache.solr.core.SolrCore@e2a601a
   [junit4]   2> 2490639 INFO  (coreCloseExecutor-3122-thread-1) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection1.shard1.replica_n41, tag=e2a601a
   [junit4]   2> 2490639 INFO  (coreCloseExecutor-3122-thread-1) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@33f21381: rootName = solr_44844, domain = solr.core.testCollection1.shard1.replica_n41, service url = null, agent id = null] for registry solr.core.testCollection1.shard1.replica_n41 / com.codahale.metrics.MetricRegistry@73d53556
   [junit4]   2> 2490651 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 2490656 INFO  (coreCloseExecutor-3122-thread-2) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.c.SolrCore [testCollection1_shard2_replica_n43]  CLOSING SolrCore org.apache.solr.core.SolrCore@424676bc
   [junit4]   2> 2490672 INFO  (OverseerCollectionConfigSetProcessor-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2490688 INFO  (coreCloseExecutor-3122-thread-3) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.c.SolrCore [testCollection2_shard1_replica_n41]  CLOSING SolrCore org.apache.solr.core.SolrCore@2d598ece
   [junit4]   2> 2490688 INFO  (coreCloseExecutor-3122-thread-3) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection2.shard1.replica_n41, tag=2d598ece
   [junit4]   2> 2490688 INFO  (coreCloseExecutor-3122-thread-3) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a8d8fc1: rootName = solr_44844, domain = solr.core.testCollection2.shard1.replica_n41, service url = null, agent id = null] for registry solr.core.testCollection2.shard1.replica_n41 / com.codahale.metrics.MetricRegistry@dd2dceb
   [junit4]   2> 2490692 INFO  (coreCloseExecutor-3122-thread-4) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.c.SolrCore [testCollection2_shard2_replica_n43]  CLOSING SolrCore org.apache.solr.core.SolrCore@50db8444
   [junit4]   2> 2490711 INFO  (coreCloseExecutor-3122-thread-3) [n:127.0.0.1:44844_solr c:testCollection2 s:shard1 r:core_node42 x:testCollection2_shard1_replica_n41] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection2.shard1.leader, tag=2d598ece
   [junit4]   2> 2490712 INFO  (coreCloseExecutor-3122-thread-1) [n:127.0.0.1:44844_solr c:testCollection1 s:shard1 r:core_node42 x:testCollection1_shard1_replica_n41] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection1.shard1.leader, tag=e2a601a
   [junit4]   2> 2490712 INFO  (coreCloseExecutor-3122-thread-2) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection1.shard2.replica_n43, tag=424676bc
   [junit4]   2> 2490712 INFO  (coreCloseExecutor-3122-thread-2) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3609d425: rootName = solr_44844, domain = solr.core.testCollection1.shard2.replica_n43, service url = null, agent id = null] for registry solr.core.testCollection1.shard2.replica_n43 / com.codahale.metrics.MetricRegistry@240e474c
   [junit4]   2> 2490860 INFO  (zkCallback-1747-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 2490878 INFO  (coreCloseExecutor-3122-thread-4) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection2.shard2.replica_n43, tag=50db8444
   [junit4]   2> 2490878 INFO  (coreCloseExecutor-3122-thread-4) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@509c709b: rootName = solr_44844, domain = solr.core.testCollection2.shard2.replica_n43, service url = null, agent id = null] for registry solr.core.testCollection2.shard2.replica_n43 / com.codahale.metrics.MetricRegistry@121dd222
   [junit4]   2> 2491053 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2491148 INFO  (coreCloseExecutor-3122-thread-4) [n:127.0.0.1:44844_solr c:testCollection2 s:shard2 r:core_node44 x:testCollection2_shard2_replica_n43] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection2.shard2.leader, tag=50db8444
   [junit4]   2> 2491219 INFO  (zkCallback-1740-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2491219 INFO  (coreCloseExecutor-3122-thread-2) [n:127.0.0.1:44844_solr c:testCollection1 s:shard2 r:core_node44 x:testCollection1_shard2_replica_n43] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection1.shard2.leader, tag=424676bc
   [junit4]   2> 2491361 INFO  (jetty-closer-1731-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72570918227083267-127.0.0.1:44844_solr-n_0000000000) closing
   [junit4]   2> 2491361 INFO  (OverseerStateUpdate-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44844_solr
   [junit4]   2> 2491362 WARN  (OverseerAutoScalingTriggerThread-72570918227083267-127.0.0.1:44844_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2491511 INFO  (jetty-closer-1731-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6d522f88{/solr,null,UNAVAILABLE}
   [junit4]   2> 2491512 INFO  (jetty-closer-1731-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 2491531 ERROR (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2491620 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36026 36026
   [junit4]   2> 2491730 INFO  (Thread-3150) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36026 36026
   [junit4]   2> 2491787 WARN  (Thread-3150) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	2	/solr/collections/testCollection2/terms/shard2
   [junit4]   2> 	2	/solr/collections/testCollection2/terms/shard1
   [junit4]   2> 	2	/solr/collections/testCollection1/terms/shard1
   [junit4]   2> 	2	/solr/collections/testCollection1/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> 2491892 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[B60225E5447CD6C7]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=906, maxMBSortInHeap=5.722082953489707, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@14119f53), locale=mk-MK, timezone=Brazil/East
   [junit4]   2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=149839400,total=479199232
   [junit4]   2> NOTE: All tests run in this JVM: [CdcrBootstrapTest, AtomicUpdateProcessorFactoryTest, TestCloudSearcherWarming, HdfsCollectionsAPIDistributedZkTest, TestRTGBase, TestNestedDocsSort, PKIAuthenticationIntegrationTest, TestSolrCoreSnapshots, NodeLostTriggerIntegrationTest, CoreSorterTest, OverseerCollectionConfigSetProcessorTest, AutoAddReplicasIntegrationTest, ZkStateReaderTest, TestStandardQParsers, BadComponentTest, HighlighterTest, NodeMutatorTest, TestSystemCollAutoCreate, DOMUtilTest, LeaderVoteWaitTimeoutTest, AlternateDirectoryTest, TestJsonFacetRefinement, HttpSolrCallGetCoreTest, MetricTriggerTest, TestNumericTerms64, TestFieldCacheSort, TestFunctionQuery, TestSQLHandlerNonCloud, ForceLeaderTest, RecoveryAfterSoftCommitTest, SortByFunctionTest, CustomHighlightComponentTest, TestHalfAndHalfDocValues, TestGenericDistributedQueue, DocExpirationUpdateProcessorFactoryTest, BJQParserTest, TestFieldTypeCollectionResource, SuggesterFSTTest, TestRTimerTree, ZkFailoverTest, TestReplicationHandler, TestCloudManagedSchema, PrimUtilsTest, TestDistribIDF, TestReload, SOLR749Test, TestSimpleTrackingShardHandler, MaxSizeAutoCommitTest, SimplePostToolTest, ChaosMonkeySafeLeaderWithPullReplicasTest, MissingSegmentRecoveryTest, TestLeaderElectionZkExpiry, TestComputePlanAction, QueryParsingTest, SliceStateTest, QueryElevationComponentTest, TestEmbeddedSolrServerSchemaAPI, BlockJoinFacetSimpleTest, SolrXmlInZkTest, TestQueryWrapperFilter, LeaderElectionContextKeyTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LeaderElectionContextKeyTest -Dtests.seed=B60225E5447CD6C7 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=mk-MK -Dtests.timezone=Brazil/East -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | LeaderElectionContextKeyTest (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not load collection from ZK: testCollection1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B60225E5447CD6C7]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1301)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:730)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:148)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:131)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElectionContextKeyTest.setupCluster(LeaderElectionContextKeyTest.java:66)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testCollection1/state.json
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:340)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:340)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1313)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1299)
   [junit4]    > 	... 29 more
   [junit4] Completed [215/806 (1!)] on J1 in 23.69s, 0 tests, 1 error <<< FAILURES!

[...truncated 52450 lines...]
[asciidoctor:convert] asciidoctor: ERROR: about-this-guide.adoc: line 1: invalid part, must have at least one section (e.g., chapter, appendix, etc.)
[asciidoctor:convert] asciidoctor: ERROR: solr-glossary.adoc: line 1: invalid part, must have at least one section (e.g., chapter, appendix, etc.)
     [java] Processed 2206 links (1762 relative) to 3066 anchors in 244 files
     [echo] Validated Links & Anchors via: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-ref-guide/bare-bones-html/

-documentation-lint:
    [jtidy] Checking for broken html (such as invalid tags)...
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/jtidy_tmp
     [echo] Checking for broken links...
     [exec] 
     [exec] Crawl/parse...
     [exec] 
     [exec] Verify...
     [echo] Checking for malformed docs...

jar-checksums:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

common.resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null375274814
     [copy] Copying 40 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null375274814
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/null375274814

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null170682750
     [copy] Copying 246 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null170682750
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/null170682750

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 72ms :: artifacts dl 4ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 757 minutes 50 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)